[ 560.241340] env[65849]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 560.241340] env[65849]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 561.230545] env[65939]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 561.230545] env[65939]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 563.069028] env[65939]: INFO neutron.common.config [-] Logging enabled! [ 563.069028] env[65939]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b3.dev34 [ 563.069488] env[65939]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65939) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 563.069638] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 563.069746] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 563.070527] env[65939]: WARNING oslo_policy.policy [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 563.070724] env[65939]: WARNING oslo_policy.policy [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 563.072513] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] VMware NSXv3 Agent initialized successfully. [ 563.072866] env[65939]: DEBUG oslo_concurrency.lockutils [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] Acquiring lock "singleton_lock" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.072991] env[65939]: DEBUG oslo_concurrency.lockutils [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] Acquired lock "singleton_lock" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.073201] env[65939]: DEBUG oslo_concurrency.lockutils [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] Releasing lock "singleton_lock" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.073487] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] Full set of CONF: {{(pid=65939) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 563.073597] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ******************************************************************************** {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 563.073697] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] Configuration options gathered from: {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 563.074032] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 563.074204] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 563.074308] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ================================================================================ {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 563.074473] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] agent_down_time = 75 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.074609] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] allow_automatic_dhcp_failover = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.074739] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] allow_bulk = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.074887] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] api_extensions_path = {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.075055] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] api_paste_config = api-paste.ini {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.075197] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] auth_strategy = keystone {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.075299] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] backdoor_port = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.075398] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] backdoor_socket = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.075528] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] backlog = 4096 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.075659] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.075818] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] bind_host = 0.0.0.0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.075971] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] bind_port = 9696 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.076118] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] client_socket_timeout = 900 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.076252] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] config_dir = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.076357] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.076491] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] config_source = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.076626] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] control_exchange = neutron {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.076759] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] core_plugin = ml2 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.076892] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] debug = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.077037] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] default_availability_zones = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.077244] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.077381] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] dhcp_agent_notification = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.077511] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] dhcp_agents_per_network = 1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.077639] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] dhcp_lease_duration = 86400 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.077822] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] dhcp_load_type = networks {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.078012] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] dns_domain = openstacklocal {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.078160] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.078292] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] enable_default_route_bfd = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.078420] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] enable_default_route_ecmp = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.078572] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] enable_dvr = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.078701] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] enable_new_agents = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.078871] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.079034] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] enable_signals = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.079172] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] enable_traditional_dhcp = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.079296] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] external_dns_driver = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.079423] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] filter_validation = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.079561] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] global_physnet_mtu = 8950 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.079686] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] graceful_shutdown_timeout = 60 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.079860] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] host = cpu-1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.079996] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] host_dvr_for_dhcp = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.080139] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] http_retries = 3 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.080274] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] instance_format = [instance: %(uuid)s] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.080405] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.080535] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ipam_driver = internal {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.080662] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ipv6_pd_enabled = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.080786] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] l3_ha = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.080953] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.081116] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] l3_ha_network_physical_name = {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.081252] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] l3_ha_network_type = {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.081391] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] log_color = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.081525] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] log_config_append = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.081656] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.081783] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] log_dir = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.081909] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] log_file = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.082017] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] log_options = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.082149] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] log_rotate_interval = 1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.082282] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] log_rotate_interval_type = days {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.082415] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] log_rotation_type = none {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.082516] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.082614] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.082747] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.082879] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.082977] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.083117] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] max_dns_nameservers = 5 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.083282] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] max_header_line = 16384 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.083426] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] max_l3_agents_per_router = 3 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.083555] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] max_logfile_count = 30 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.083679] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] max_logfile_size_mb = 200 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.083809] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] max_subnet_host_routes = 20 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.083943] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] my_ip = 10.180.1.21 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.084087] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] my_ipv6 = ::1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.084218] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] network_auto_schedule = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.084339] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] network_link_prefix = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.084469] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.084604] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] notify_nova_on_port_data_changes = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.084735] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] notify_nova_on_port_status_changes = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.084866] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] pagination_max_limit = -1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.084991] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] publish_errors = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.085130] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] rate_limit_burst = 0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.085264] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] rate_limit_except_level = CRITICAL {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.085387] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] rate_limit_interval = 0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.085511] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] retry_until_window = 30 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.085634] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] router_distributed = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.085759] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] rpc_resources_processing_step = 20 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.085908] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] rpc_response_max_timeout = 600 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.086057] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] rpc_response_timeout = 60 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.086186] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] send_events_interval = 2 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.086352] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] service_plugins = ['router'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.086494] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] setproctitle = on {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.086614] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] shell_completion = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.086745] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] state_path = /opt/stack/data/neutron {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.086877] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] syslog_log_facility = LOG_USER {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.087024] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] tcp_keepidle = 600 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.087149] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] transport_url = **** {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.087275] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] use_journal = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.087398] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] use_json = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.087521] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] use_ssl = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.087643] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] use_stderr = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.087774] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] use_syslog = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.087919] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] vlan_qinq = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.088075] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] vlan_transparent = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.088207] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] wsgi_default_pool_size = 100 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.088337] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] wsgi_keep_alive = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.088473] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.088602] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] wsgi_server_debug = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.088742] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_concurrency.disable_process_locking = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.088883] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089077] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089246] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089461] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089623] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089761] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089910] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.connection_string = messaging:// {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090064] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.enabled = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090210] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.es_doc_type = notification {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090373] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.es_scroll_size = 10000 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090534] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.es_scroll_time = 2m {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090673] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.filter_error_trace = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090811] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.hmac_keys = **** {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090948] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.sentinel_service_name = mymaster {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091110] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.socket_timeout = 0.1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091245] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.trace_requests = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091377] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler.trace_sqlalchemy = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091524] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler_jaeger.process_tags = {} {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091656] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler_jaeger.service_name_prefix = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091789] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] profiler_otlp.service_name_prefix = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091936] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.enforce_new_defaults = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092215] env[65939]: WARNING oslo_config.cfg [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 563.092389] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.enforce_scope = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092537] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.policy_default_rule = default {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092684] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092821] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092960] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093107] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093236] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093364] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093495] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093630] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093777] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093918] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] agent.extensions = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094066] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094208] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] service_providers.service_provider = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094346] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.default_quota = -1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094485] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094615] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.quota_floatingip = 50 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094742] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.quota_network = 100 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094868] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.quota_port = 500 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094995] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095137] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.quota_router = 10 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095276] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.quota_security_group = 10 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095435] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095572] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.quota_subnet = 100 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095702] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] QUOTAS.track_quota_usage = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095884] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096008] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep.group = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096145] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep.helper_command = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096277] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep.log_daemon_traceback = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096414] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096544] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep.thread_pool_size = 8 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096670] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep.user = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096810] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096939] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_dhcp_release.group = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097075] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_dhcp_release.helper_command = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097205] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097337] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097465] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097593] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_dhcp_release.user = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097726] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097851] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_ovs_vsctl.group = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097978] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098142] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098304] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098454] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098599] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_ovs_vsctl.user = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098732] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_namespace.capabilities = [21] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098860] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_namespace.group = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098991] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_namespace.helper_command = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099137] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099329] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099482] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099612] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_namespace.user = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099751] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_conntrack.capabilities = [12] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099880] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_conntrack.group = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100016] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_conntrack.helper_command = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100152] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100288] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100420] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100545] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_conntrack.user = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100680] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_link.capabilities = [12, 21] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100805] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_link.group = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100930] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_link.helper_command = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101069] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_link.log_daemon_traceback = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101204] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101352] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_link.thread_pool_size = 8 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101492] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] privsep_link.user = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101649] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101787] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101921] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.continue_on_failed_promotions = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102063] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.dscp = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102200] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.dscp_inherit = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102339] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.force_mp_to_policy = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102470] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.locking_coordinator_url = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102600] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.log_agent_heartbeats = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102732] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.logging_expire = 1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102870] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103022] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103156] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.polling_interval = 240 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103291] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103428] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103566] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.report_interval = 30.0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103703] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103863] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104014] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104157] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.sync_skew = 60 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104293] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.synchronization_queue_size = 20 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104428] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT.use_helper_for_ns_read = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104570] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] SECURITYGROUP.enable_ipset = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104716] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] SECURITYGROUP.enable_security_group = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104849] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104989] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105140] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] experimental.ipv6_pd_enabled = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105292] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ml2.extension_drivers = ['port_security'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105424] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ml2.external_network_type = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105570] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105712] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ml2.overlay_ip_version = 4 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105863] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ml2.path_mtu = 8950 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.106022] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ml2.physical_network_mtus = {} {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.106180] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.106330] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.106474] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ml2.type_drivers = ['vlan'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.106619] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.106758] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.106922] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.107101] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.107250] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.107390] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.107528] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.107667] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.107804] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.108009] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.108193] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_login_password = **** {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.108368] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.108524] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_login_user = admin {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.108663] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.108803] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.108937] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.109095] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.109278] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.109453] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.109636] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.109781] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.109916] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.110069] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.110245] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.110390] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.110530] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.110714] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.110857] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.110996] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.111143] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.111278] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.auth_section = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.111420] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.auth_type = password {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.111559] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.111687] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.certfile = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.111819] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.collect_timing = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.111959] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.endpoint_type = public {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.112137] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.insecure = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.112299] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.keyfile = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.112449] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.region_name = RegionOne {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.112584] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.split_loggers = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.112712] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] nova.timeout = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.112849] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.auth_section = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.112991] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.auth_type = password {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.113142] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.113301] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.certfile = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.113451] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.collect_timing = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.113593] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.endpoint_type = public {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.113727] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.insecure = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.113855] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.keyfile = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.113982] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.region_name = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.114126] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.split_loggers = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.114250] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] placement.timeout = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.114413] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.auth_section = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.114550] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.auth_type = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.114676] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.cafile = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.114801] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.certfile = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.114929] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.collect_timing = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.115069] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.connect_retries = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.115198] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.connect_retry_delay = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.115330] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.enable_notifications = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.115481] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.endpoint_override = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.115616] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.insecure = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.115744] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.interface = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.115889] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.keyfile = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.116042] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.max_version = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.116173] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.min_version = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.116301] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.region_name = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.116429] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.retriable_status_codes = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.116557] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.service_name = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.116684] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.service_type = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.116820] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.split_loggers = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.116945] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.status_code_retries = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.117084] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.status_code_retry_delay = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.117212] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.timeout = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.117339] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.valid_interfaces = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.117467] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ironic.version = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.117603] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] cli_script.dry_run = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.117741] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.117871] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.118008] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.118144] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.118273] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.118431] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.118605] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.118759] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.118894] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.119046] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.119180] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.119321] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.119457] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.119595] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.119781] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.119934] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.120083] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.120217] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.120356] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.120488] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.120621] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.120749] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.120878] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.121014] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.121147] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.121275] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.121422] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.121568] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.121698] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.121827] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.121956] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.ssl = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.122107] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.122244] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.122373] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.122506] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.122639] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.122770] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.122909] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_notifications.driver = [] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.123052] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_notifications.retry = -1 {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.123198] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.123326] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.123428] env[65939]: DEBUG oslo_service.backend._eventlet.service [None req-1983ee5d-c2d5-4478-8f69-7fa997dad9d6 None None] ******************************************************************************** {{(pid=65939) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 563.124661] env[65939]: DEBUG neutron.agent.securitygroups_rpc [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Init firewall settings (driver=nsxv3) {{(pid=65939) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 563.125978] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65939) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 563.126226] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] RPC agent_id: nsxm-l-01a.corp.local [ 563.128404] env[65939]: DEBUG dogpile.cache.region [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 563.128529] env[65939]: DEBUG dogpile.lock [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 563.128628] env[65939]: DEBUG dogpile.lock [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 563.128721] env[65939]: DEBUG dogpile.lock [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 563.128832] env[65939]: DEBUG dogpile.cache.region [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 563.128921] env[65939]: DEBUG dogpile.lock [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 563.129054] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 563.161289] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Session token - acquiring [ 563.162819] env[65939]: DEBUG networking_nsxv3.common.locking [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.163048] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.163111] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.163512] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.173948] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.447056] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 563.469254] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 563.469451] env[65939]: DEBUG dogpile.cache.region [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Cache value generated in 0.340 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 563.469575] env[65939]: DEBUG dogpile.lock [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 563.469637] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Activating Policy API Provider. [ 563.469809] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Looking for the default Infrastructure Rules. [ 563.545760] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Looking for the Default Layer3 Logged Drop Section. [ 563.564704] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 563.565224] env[65939]: DEBUG networking_nsxv3.common.locking [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.565397] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.565497] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.565784] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.566203] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 564.081752] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 564.583766] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 565.086421] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Inventory metadata is going to be refreshed. [ 565.086784] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 565.880990] env[65939]: DEBUG networking_nsxv3.common.locking [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.881317] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.881317] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.881586] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.892606] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 565.894552] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.895167] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 565.912440] env[65939]: DEBUG networking_nsxv3.common.locking [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.912631] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.912691] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.912961] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.913117] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.913300] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 565.913418] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.913520] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 565.933101] env[65939]: DEBUG networking_nsxv3.common.locking [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.933313] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.933359] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.933618] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.933797] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.934009] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 565.956230] env[65939]: DEBUG networking_nsxv3.common.locking [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.956434] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.956517] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.956795] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.957029] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.957172] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 565.978899] env[65939]: DEBUG networking_nsxv3.common.locking [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.979126] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.979173] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.979463] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.979599] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.979746] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 565.979844] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.979943] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 565.998102] env[65939]: DEBUG networking_nsxv3.common.locking [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.998314] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.998416] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.998656] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.998771] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.998907] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 565.999207] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 565.999324] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 566.019892] env[65939]: DEBUG networking_nsxv3.common.locking [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.020112] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.020171] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.020445] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.020581] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.020788] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 566.020912] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 566.021055] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Inventory metadata have been refreshed. [ 566.021154] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Dryrun:True. Metadata refresh completed. [ 566.021276] env[65939]: DEBUG oslo_concurrency.lockutils [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.022950] env[65939]: INFO neutron.agent.agent_extensions_manager [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Loaded agent extensions: [] [ 566.023684] env[65939]: DEBUG neutron_lib.callbacks.manager [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65939) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 566.084012] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent RPC Daemon Started! [ 566.084186] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:0 started [ 566.084289] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent out of sync with plugin! [ 571.024395] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.024395] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 572.026637] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.027100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.027100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.027363] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.027591] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 572.530249] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 573.032374] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 573.539094] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 573.539334] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 574.301408] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.301944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.301944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.301944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.316176] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 574.317182] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.317880] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 574.338585] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.338905] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.338905] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.339126] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.339198] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.339250] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 574.339321] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.339402] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 574.362692] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.363049] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.363049] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.363270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.363395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.363959] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 574.388636] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.388881] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.388881] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.389143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.389269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.389383] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 574.420096] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.420096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.420096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.420096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.420096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.420096] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 574.420656] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.420656] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 574.445974] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.446338] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.446338] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.446501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.446559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.446803] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 574.446803] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.446803] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 574.470066] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.470298] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.470394] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.470708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.470920] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.471099] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 574.471208] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.471347] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 574.471453] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 574.471572] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 574.471647] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 574.471710] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 574.478198] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 574.478360] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 574.478459] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 574.502628] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.502914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.502914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.503131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.503265] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.503390] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 574.526265] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.526493] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.526493] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.526752] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.526935] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.558581] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.026093] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 576.026093] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.762792] env[65939]: INFO networking_nsxv3.common.synchronization [None req-5d407532-101f-44d7-8427-961d82418350 demo admin] Enqueued Resource ID: e5c1c09c-c342-4d4e-8bad-f185a31edc94 with Priority: HIGHEST for action security_group_rules [ 580.763600] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c1c09c-c342-4d4e-8bad-f185a31edc94 with Priority: HIGHEST for action security_group_rules [ 580.763907] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5c1c09c-c342-4d4e-8bad-f185a31edc94 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.764051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5c1c09c-c342-4d4e-8bad-f185a31edc94" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.764124] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5c1c09c-c342-4d4e-8bad-f185a31edc94" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.764371] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5c1c09c-c342-4d4e-8bad-f185a31edc94" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.764457] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5c1c09c-c342-4d4e-8bad-f185a31edc94',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 581.287021] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.287266] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.287266] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.287444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.287533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.287632] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5c1c09c-c342-4d4e-8bad-f185a31edc94 already deleted. [ 581.287715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5c1c09c-c342-4d4e-8bad-f185a31edc94" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.764295] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 585.764729] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 590.765870] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 590.766164] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 595.766892] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 595.767325] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 600.768528] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 600.768965] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 605.769519] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 605.770238] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 610.771301] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 610.771701] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 615.772101] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 615.772506] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 620.773689] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 620.774119] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 625.774557] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 625.774557] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 630.775383] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 630.775792] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 635.776433] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 635.776877] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 640.777928] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 640.778438] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 645.779649] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 645.779649] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 650.780849] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 650.780849] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 655.782255] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 655.782675] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 660.783358] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 660.783778] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 665.784404] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 665.784832] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 670.786019] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 670.786470] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 675.787416] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 675.787914] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 680.789091] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 680.789091] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 685.790637] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 685.790637] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 690.791156] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 690.791556] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 695.792336] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 695.792336] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 700.793379] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 700.793776] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 705.794233] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 705.794652] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 710.795964] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 710.796387] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 715.797475] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 715.797908] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 720.799172] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 720.799536] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 725.800734] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 725.801196] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 730.802459] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 730.802920] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 735.804467] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 735.804885] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 740.805742] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 740.806178] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 745.807392] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 745.808229] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 750.809634] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 750.809928] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 755.811449] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 755.811867] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 760.813299] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 760.813716] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 765.815195] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 765.815603] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 770.816262] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 770.816703] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 775.817982] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 775.818450] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 780.819734] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 780.820259] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 785.820947] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 785.820947] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 790.821918] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 790.821918] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 795.822887] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 795.823320] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 800.824198] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 800.824688] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 805.826075] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 805.826528] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 806.084760] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 806.084919] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:1 started [ 810.827445] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 810.827445] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 812.029481] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.029899] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.029899] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.029899] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.030087] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 812.531951] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 813.034339] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 813.536686] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 813.536963] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 814.251328] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.251787] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.251787] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.251787] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.263823] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 814.264688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.265351] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 814.285412] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.285617] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.285617] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.285815] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.285926] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.286019] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 814.286096] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 814.286166] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 814.305123] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.305305] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.305395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.305649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.305789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.305903] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 814.327537] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.327735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.327735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.327996] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.328174] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.328306] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 814.351072] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.351253] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.351308] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.351487] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.351590] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.351709] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 814.351785] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 814.351857] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 814.372047] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.372221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.372275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.372455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.372540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.372647] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 814.372719] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 814.372788] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 814.394266] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.394467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.394467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.394669] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.394786] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.394902] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 814.394976] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 814.395062] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 814.395186] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 814.395186] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 814.395267] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 814.395303] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 814.395373] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 814.395419] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 814.395479] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 814.415959] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.416152] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.416219] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.416370] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.416471] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.416581] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 814.436746] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.436956] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.436998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.437190] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.437289] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.452275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.828306] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 815.828719] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 820.830094] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 820.830505] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 825.831220] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 825.831718] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 830.832628] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 830.832999] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 835.834393] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 835.834857] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 840.835895] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 840.836277] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 845.837582] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 845.838038] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 850.838650] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 850.839135] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 855.839670] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 855.840123] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 860.841135] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 860.841557] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 865.842057] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 865.842584] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 870.843052] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 870.843429] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 875.844123] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 875.844530] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 880.845262] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 880.845715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 885.847093] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 885.847500] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 890.847990] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 890.848430] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 895.848973] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 895.849424] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 900.850591] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 900.850591] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 905.851411] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 905.851411] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 910.852631] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 910.853086] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 915.853640] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 915.854478] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 920.855623] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 920.856032] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 925.856821] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 925.857282] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 930.857733] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 930.858169] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 935.858484] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 935.858911] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 940.859872] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 940.860318] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 945.860684] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 945.861140] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 950.861920] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 950.862409] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 955.862995] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 955.863522] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 960.864380] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 960.864741] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 965.865995] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 965.866780] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 970.868516] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 970.868516] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 975.869412] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 975.871281] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 980.870388] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 980.870388] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 985.871821] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 985.872351] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 990.873156] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 990.873700] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 995.874646] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 995.875154] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1000.875495] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1000.875950] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1005.876334] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1005.876874] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1010.878073] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1010.878073] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1015.879515] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1015.880334] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1020.880962] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1020.881650] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1025.882530] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1025.882530] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1030.883970] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1030.884427] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1035.884720] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1035.885151] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1040.885669] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1040.885669] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1045.886858] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1045.888715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1046.085532] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1046.085729] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1050.888341] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1050.888341] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1052.034053] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.034053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.034053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.034053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.034053] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1052.536291] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1053.038824] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1053.541109] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1053.541301] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1054.290514] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.290927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.290927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.290927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.302802] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1054.303600] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.304249] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1054.323294] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.323489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.323489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.323699] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.323783] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.323895] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1054.323967] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1054.324052] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1054.342946] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.343174] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.343174] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.343344] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.343485] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.343591] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1054.362481] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.362622] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.362674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.362851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.362949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.363071] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1054.380672] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.380828] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.380866] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.381074] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.381179] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.381291] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 1054.381372] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1054.381442] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1054.397067] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.397197] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.397279] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.397443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.397527] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.397628] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1054.397696] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1054.397766] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1054.419390] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.419588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.419588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.419763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.419863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.419970] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1054.420068] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1054.420145] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1054.420209] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1054.420283] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 1054.420343] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1054.420402] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1054.420472] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1054.420528] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1054.420589] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1054.442329] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.442504] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.442561] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.442750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.442857] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.442967] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1054.463982] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.464258] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.464258] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.464413] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.464550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.476694] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.888904] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1055.889352] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1060.890110] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1060.890110] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1065.891131] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1065.891588] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1070.892362] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1070.892727] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1075.893768] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1075.894227] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1080.895435] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1080.895883] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1085.896641] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1085.897111] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1090.897443] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1090.897829] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1095.899224] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1095.899597] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1100.901258] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1100.901676] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1105.903343] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1105.903759] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1110.904463] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1110.904689] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1115.906389] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1115.906802] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1120.908113] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1120.908412] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1125.909300] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1125.909819] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1130.910584] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1130.911043] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1135.911735] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1135.912195] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1140.913617] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1140.913617] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1145.914538] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1145.914954] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1150.916092] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1150.916544] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1155.917222] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1155.917679] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1160.918403] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1160.918815] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1165.920198] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1165.920612] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1170.922089] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1170.922521] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1175.923993] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1175.924420] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1180.925369] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1180.925783] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1185.926631] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1185.927090] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1190.927651] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.928085] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1195.928800] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1195.929297] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1200.930689] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.930689] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1205.932044] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1205.932493] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1210.933310] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1210.933723] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1215.934529] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.934901] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1220.935931] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1220.936438] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1225.937074] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.937506] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1230.938906] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.939354] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1235.939948] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1235.940338] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1240.941093] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.941093] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1245.942259] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1245.942674] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1250.943706] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.944266] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1255.945022] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.945390] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1260.947039] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1260.947496] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1265.949019] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.949461] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.950662] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.950662] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1275.952070] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.952433] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1280.953383] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.953739] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.954534] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.954917] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1286.086822] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1286.087089] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1290.955478] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.955927] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1292.038133] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.038560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.038560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.038650] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.038776] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1292.541812] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1293.045083] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1293.548052] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1293.548052] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1294.334600] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.335032] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.335032] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.335169] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.347273] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1294.348061] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.348683] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1294.366609] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.366767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.366819] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.367019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.367111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.367237] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1294.367313] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1294.367383] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1294.386768] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.386941] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.386980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.387172] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.387304] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.387411] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1294.406123] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.406321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.406321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.406528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.406633] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.406746] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1294.426694] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.426918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.426986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.427290] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.427431] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.427560] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 1294.427634] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1294.427704] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1294.443940] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.444115] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.444202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.444330] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.444415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.444535] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1294.444605] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1294.444676] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1294.463284] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.463538] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.463538] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.463700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.463803] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.463918] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1294.463988] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1294.464068] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1294.464130] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1294.464203] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 1294.464262] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1294.464322] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1294.464392] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1294.464450] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1294.464529] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1294.482287] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.482433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.482467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.482655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.482754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.482860] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1294.501371] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.501552] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.501601] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.501779] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.501877] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.521836] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.956905] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.957238] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1300.958326] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.958688] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.959659] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.960052] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1310.961343] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.961716] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.962722] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.963210] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1320.964101] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.964453] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1325.964927] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.965344] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.966657] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.966657] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.967614] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.967614] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.968445] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.968844] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.969635] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.969635] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.970433] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.970818] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.971394] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.971762] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.972504] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.972949] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1365.973473] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.973473] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1370.974878] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.975297] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1375.975861] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1375.976344] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1380.976875] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.976875] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.977634] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.977634] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.979033] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.979758] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.980727] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.980727] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.981418] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.981837] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.982356] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.982759] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.983449] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.983449] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1415.985082] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.985082] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.986449] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.986859] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1425.987406] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.987857] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.988571] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.988927] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.989685] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.989685] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.990535] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.990795] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.991826] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.992273] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.993102] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.993457] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.994178] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.994602] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.995345] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.995663] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.996644] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.997080] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.997520] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.997817] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.998330] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.998699] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.999266] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.999701] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.001203] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.001606] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.002679] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.003135] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.004427] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.004860] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.006155] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.006625] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.007669] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.008492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1511.009729] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1511.010567] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1516.011983] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.012378] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1521.013684] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.014131] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.015326] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.015326] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.087891] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1526.088098] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1531.017076] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1531.017520] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.043342] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.043839] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.043839] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.043913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.044025] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1532.546198] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1533.048639] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1533.551100] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1533.551379] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1534.323715] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.324278] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.324278] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.324278] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.336375] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1534.337185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.337887] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1534.357851] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.358044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.358102] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.358264] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.358351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.358462] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1534.358542] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1534.358612] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1534.377941] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.378175] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.378175] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.378346] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.378479] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.378611] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1534.399069] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.399246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.399300] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.399465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.399568] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.399676] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1534.423852] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.424093] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.424093] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.424300] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.424406] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.424526] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 1534.424598] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1534.424668] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1534.443453] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.443637] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.443694] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.443854] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.443940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.444062] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1534.444151] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1534.444226] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1534.467233] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.467445] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.467445] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.467625] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.467721] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.467835] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1534.467904] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1534.467968] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1534.468042] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1534.468115] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 1534.468172] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1534.468232] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1534.468300] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1534.468353] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1534.468415] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1534.488595] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.488771] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.488807] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.488984] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.489099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.489210] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1534.507396] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.507604] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.507604] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.507775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.507872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.519155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.018320] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1536.018718] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1541.019757] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1541.020179] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1546.021524] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.021936] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1551.023628] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.023628] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1556.025280] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.025684] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.026677] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1561.027128] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1566.028428] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.028428] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1571.029602] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.030063] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.030908] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.031393] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.033082] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.033082] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.033836] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.034257] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.035297] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.035748] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.036951] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.037348] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1601.038359] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.038359] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1606.039720] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.040170] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1611.040989] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1611.041423] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1616.042873] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1616.043346] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1621.044548] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1621.044995] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1626.046129] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1626.046545] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1631.047294] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1631.047783] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1636.048823] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1636.049312] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1641.050345] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1641.050345] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1646.051360] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1646.051841] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1651.052718] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1651.053207] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1656.054172] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1656.054576] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1661.055136] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1661.055897] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1666.057688] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1666.057688] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1671.058904] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1671.058904] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1676.060528] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1676.060528] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1681.061236] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1681.061657] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1686.062115] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1686.062574] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1691.063373] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1691.063838] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1696.064768] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1696.064768] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1701.065860] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1701.066325] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1706.066944] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1706.067364] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1711.068113] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1711.068554] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1716.069626] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1716.070062] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1721.071085] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1721.071085] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1726.071787] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1726.072212] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1731.072693] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1731.073179] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1736.073942] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1736.074325] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1741.075411] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1741.075871] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1746.076363] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1746.076783] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1751.077831] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1751.078317] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1756.079016] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1756.079457] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1761.080079] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1761.080505] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1766.081021] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1766.081424] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1766.088542] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1766.088687] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:5 started [ 1771.082419] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1771.082419] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1772.041071] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1772.041071] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1772.041071] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1772.041071] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1772.041071] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1772.542768] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1773.044923] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 1773.548129] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1773.548129] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1774.292417] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.292653] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.292653] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.292844] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.305240] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1774.306059] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.306793] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1774.326522] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.326698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.326754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.326924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.327016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.327132] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1774.327202] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1774.327272] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1774.345602] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.345779] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.345820] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.345986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.346134] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.346267] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1774.365069] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.365250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.365326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.365456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.365559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.365668] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1774.386137] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.386370] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.386370] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.386569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.386667] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.386777] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 1774.386847] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1774.386913] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1774.404086] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.404254] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.404313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.404480] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.404569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.404722] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1774.404811] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1774.404884] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1774.424038] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.424232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.424232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.424442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.424541] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.424651] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1774.424720] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1774.424786] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1774.424849] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1774.424920] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 1774.424981] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1774.425050] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1774.425120] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1774.425173] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1774.425238] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1774.442929] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.443110] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.443186] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.443321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.443453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.443556] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1774.460875] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1774.461082] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1774.461082] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1774.461259] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1774.461345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1774.471647] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1776.083575] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1776.083999] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1781.084936] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1781.085367] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1786.085981] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1786.086425] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1791.087023] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1791.087438] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1796.088059] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1796.088491] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1801.089804] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1801.089804] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1806.090297] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1806.090707] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1811.091265] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1811.091678] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1816.092623] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1816.093096] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1821.093256] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1821.093762] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1826.093799] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1826.094170] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1831.095232] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1831.095616] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1836.096228] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1836.096654] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1841.097272] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1841.097698] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1846.098189] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1846.098501] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1851.099331] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1851.099808] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1856.100052] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1856.100454] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1861.101580] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1861.102116] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1866.103065] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1866.103435] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1871.104348] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1871.104809] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1876.105673] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1876.105673] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1881.107113] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1881.107537] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1886.107863] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1886.108287] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1891.109199] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1891.109596] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1896.109787] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1896.110535] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1901.112230] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1901.112649] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1906.112767] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1906.113178] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1911.113990] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1911.114408] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1916.114790] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1916.115224] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1921.116037] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1921.116504] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1926.116798] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1926.117197] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1931.117624] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1931.118163] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1936.119072] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1936.119072] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1941.119650] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1941.120092] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1946.120948] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1946.120948] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1951.122409] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1951.122409] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1956.123094] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1956.123532] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1961.123766] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1961.124206] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1966.124773] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1966.125283] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1971.125548] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1971.125995] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1976.126877] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1976.127258] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1981.127516] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1981.127961] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1986.128946] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1986.128946] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1991.129739] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1991.130247] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1996.130349] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1996.130715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2001.131526] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2001.131923] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2006.088991] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:5 completed [ 2006.089422] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:6 started [ 2006.132758] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2006.132928] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2011.133954] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2011.134371] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2012.043078] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2012.043319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2012.043319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2012.043563] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2012.043669] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2012.546621] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2013.049442] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2013.551474] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2013.551742] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2014.285999] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.286246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.286246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.286458] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.298512] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2014.299314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.300086] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2014.319082] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.319286] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.319286] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.319497] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.319581] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.319693] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 2014.319766] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2014.319836] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2014.339281] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.339436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.339489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.339663] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.339796] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.339909] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2014.359728] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.359915] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.359915] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.360173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.360314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.360393] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2014.379377] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.379565] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.379621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.379804] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.379912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.380072] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 2014.380153] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2014.380226] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2014.397700] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.397904] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.397904] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.398146] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.398238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.398349] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2014.398422] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2014.398493] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2014.416814] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.416984] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.417052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.417235] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.417344] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.417466] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2014.417542] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2014.417610] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2014.417675] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 2014.417750] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 2014.417814] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2014.417875] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2014.417943] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 2014.417997] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 2014.418071] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2014.437394] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.437626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.437626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.437781] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.437905] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.438024] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2014.455934] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2014.456116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2014.456188] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2014.456349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2014.456456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2014.471166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2016.135448] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2016.135848] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2021.136492] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2021.137296] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2026.138338] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2026.138741] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2031.139369] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2031.139784] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2036.140809] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2036.141234] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2041.141370] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2041.141775] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2046.142116] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2046.142520] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2051.143750] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2051.144256] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2056.145068] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2056.145068] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2061.145724] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2061.146244] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2066.146885] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2066.147315] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2071.148129] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2071.148550] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2076.148752] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2076.149493] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2081.150879] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2081.150879] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2086.151790] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2086.151790] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2091.152928] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2091.153380] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2096.153886] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2096.154277] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2101.154640] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2101.155029] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2106.155533] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2106.155948] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2111.156371] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2111.156771] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2116.157220] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2116.157621] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2121.157885] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2121.158311] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2126.158822] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2126.159296] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2131.160344] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2131.161138] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2136.162359] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2136.162359] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2141.163742] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2141.164197] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2146.165169] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2146.165572] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2151.166611] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2151.167029] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2156.168021] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2156.168021] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2161.168693] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2161.168693] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2166.169412] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2166.169412] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2171.170247] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2171.170247] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2176.171388] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2176.171388] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2181.171798] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2181.172230] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2186.172821] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2186.173557] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2191.174645] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2191.175122] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2196.175935] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2196.175935] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2201.176546] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2201.176970] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2206.177677] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2206.177677] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2211.178881] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2211.178881] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2216.180067] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2216.180509] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2221.180994] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2221.180994] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2226.181985] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2226.181985] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2231.182774] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2231.182774] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2236.184056] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2236.184056] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2241.185172] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2241.185546] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2246.089918] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:6 completed [ 2246.090354] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:7 started [ 2246.185910] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2246.186133] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2251.186884] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2251.187290] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2252.042965] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2252.043326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2252.043326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2252.043654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2252.043801] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2252.546150] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2253.049088] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2253.551352] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2253.551767] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2254.366060] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2254.366060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2254.366060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2254.366060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2254.378137] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2254.378918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2254.379585] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2254.398179] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2254.398333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2254.398386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2254.398577] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2254.398662] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2254.398774] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 2254.398843] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2254.398908] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2254.420836] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2254.421052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2254.421052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2254.421241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2254.421369] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2254.421477] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2254.440304] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2254.440499] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2254.440499] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2254.440682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2254.440784] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2254.440898] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2254.459060] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2254.459205] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2254.459240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2254.459428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2254.459522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2254.459630] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 2254.459699] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2254.459769] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2254.476148] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2254.476328] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2254.476328] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2254.476548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2254.476631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2254.476735] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2254.476805] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2254.476873] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2254.498570] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2254.498766] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2254.498766] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2254.498967] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2254.499083] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2254.499201] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2254.499273] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2254.499338] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2254.499402] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 2254.499473] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 2254.499532] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2254.499591] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2254.499663] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 2254.499719] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 2254.499783] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2254.520212] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2254.520441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2254.520441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2254.520614] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2254.520722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2254.520832] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2254.556782] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2254.557211] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2254.557211] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2254.557211] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2254.557317] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2254.569385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2256.187558] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2256.188289] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2261.189474] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2261.189474] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2266.190145] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2266.190145] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2271.191260] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2271.191647] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2276.191892] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2276.192314] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2281.192914] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2281.192914] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2286.193885] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2286.193885] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2291.194884] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2291.195434] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2296.195988] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2296.195988] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2301.197301] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2301.197301] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2306.198129] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2306.198129] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2311.199288] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2311.199688] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2316.200142] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2316.200523] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2321.201244] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2321.201244] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2326.201850] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2326.202266] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2331.202523] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2331.202917] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2336.204050] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2336.204449] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2341.205390] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2341.205390] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2346.206467] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2346.206467] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2351.207591] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2351.208051] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2356.208507] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2356.208507] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2361.209862] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2361.210302] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2366.210996] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2366.211406] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2371.212620] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2371.212620] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2376.213227] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2376.213856] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2381.215152] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2381.215543] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2386.216741] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2386.216741] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2391.218084] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2391.218461] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2396.219041] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2396.219041] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2401.220433] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2401.220816] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2406.221654] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2406.221654] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2411.222781] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2411.222781] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2416.224188] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2416.224628] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2421.225616] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2421.226141] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2426.227050] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2426.227442] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2431.227915] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2431.228360] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2436.228711] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2436.229155] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2441.230116] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2441.230529] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2446.231033] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2446.231467] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2451.232532] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2451.232532] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2456.233914] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2456.233914] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2461.234634] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2461.234634] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2466.235910] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2466.236364] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2471.237220] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2471.238572] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2476.239161] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2476.239542] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2481.240330] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2481.240761] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2486.091590] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:7 completed [ 2486.092494] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:8 started [ 2486.241234] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2486.241234] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2491.242725] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2491.243184] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2492.040561] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2492.040835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2492.040835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2492.041037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2492.041136] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2492.543803] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2493.046581] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2493.548790] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2493.549201] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2494.303517] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2494.303799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2494.303799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2494.303962] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2494.316972] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2494.317797] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2494.318494] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2494.337691] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2494.337921] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2494.337921] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2494.338116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2494.338202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2494.338312] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 2494.338385] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2494.338453] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2494.356993] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2494.357183] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2494.357183] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2494.357383] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2494.357508] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2494.357613] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2494.378601] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2494.378797] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2494.378797] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2494.379015] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2494.379152] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2494.379263] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2494.397590] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2494.397756] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2494.397796] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2494.397995] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2494.398111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2494.398221] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 2494.398290] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2494.398356] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2494.414912] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2494.415140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2494.415140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2494.415337] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2494.415416] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2494.415522] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2494.415592] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2494.415662] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2494.435899] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2494.436096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2494.436096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2494.436297] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2494.436413] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2494.436502] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2494.436571] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2494.436634] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2494.436742] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 2494.436846] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 2494.436846] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2494.436915] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2494.436989] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 2494.437059] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 2494.437104] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2494.456314] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2494.456521] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2494.456521] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2494.456718] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2494.456809] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2494.456915] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2494.477139] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2494.477322] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2494.477369] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2494.477531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2494.477630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2494.488873] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2496.244389] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2496.244788] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2501.245601] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2501.246078] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2506.246753] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2506.247248] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2511.248193] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2511.248667] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2516.249354] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2516.249663] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2521.250606] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2521.250974] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2526.251353] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2526.251625] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2531.252703] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2531.253157] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2536.253692] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2536.254129] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2541.255056] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2541.255517] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2546.256842] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2546.256842] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2551.258095] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2551.258866] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2556.259330] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2556.259941] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2561.260865] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2561.261355] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2566.261873] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2566.262331] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2571.263423] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2571.263896] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2576.264712] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2576.265044] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2581.265290] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2581.265723] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2586.266176] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2586.266536] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2591.267059] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2591.267059] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2596.268426] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2596.268839] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2601.269868] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2601.270328] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2606.270673] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2606.270976] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2611.271814] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2611.272244] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2616.272639] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2616.273033] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2621.273901] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2621.274338] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2626.275293] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2626.275969] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2631.277225] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2631.277620] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2636.278020] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2636.278448] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2641.279064] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2641.279499] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2646.280072] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2646.280423] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2651.281171] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2651.281580] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2656.282437] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2656.282901] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2661.283220] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2661.283667] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2666.284285] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2666.284285] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2671.285596] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2671.285596] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2676.287267] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2676.287267] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2681.287863] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2681.288291] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2686.288864] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2686.288864] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2691.289632] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2691.290320] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2696.290336] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2696.290830] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2701.291421] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2701.291823] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2706.292627] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2706.292944] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2711.293424] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2711.293781] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2716.294701] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2716.295114] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2721.295676] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2721.296064] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2726.092799] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:8 completed [ 2726.093348] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:9 started [ 2726.296202] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2726.296325] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2731.297756] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2731.298530] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2732.040733] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.040733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2732.040733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2732.041049] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2732.041049] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2732.543188] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2733.045687] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2733.547535] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2733.547992] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2734.309522] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2734.309747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2734.309791] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2734.309993] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2734.323394] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2734.324238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2734.324977] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2734.348139] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2734.348344] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2734.348344] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2734.348545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2734.348630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2734.348739] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 2734.348809] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2734.348878] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2734.373080] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2734.373251] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2734.373306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2734.373483] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2734.373617] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2734.373729] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2734.394425] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2734.394641] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2734.394641] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2734.394854] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2734.394958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2734.395086] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2734.428088] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2734.428281] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2734.428281] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2734.428495] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2734.428613] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2734.428734] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 2734.428803] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2734.428871] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2734.449333] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2734.449554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2734.449554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2734.449777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2734.449861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2734.449967] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2734.450045] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2734.450113] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2734.473307] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2734.473514] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2734.473514] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2734.473724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2734.473825] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2734.473939] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2734.474012] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2734.474083] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2734.474146] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 2734.474209] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 2734.474271] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2734.474318] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2734.474390] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 2734.474442] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 2734.474504] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2734.494330] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2734.494495] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2734.494495] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2734.494696] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2734.494800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2734.494913] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2734.513482] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2734.513671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2734.513671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2734.513869] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2734.513968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2734.525165] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2736.299423] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2736.299886] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2741.300476] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2741.300930] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2746.301969] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2746.302703] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2751.303346] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2751.303729] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2756.304630] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2756.305061] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2761.306074] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2761.306074] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2766.306852] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2766.307228] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2771.307970] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2771.308477] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2776.309939] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2776.309939] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2781.311269] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2781.311726] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2786.311703] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2786.312133] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2791.312945] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2791.313376] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2796.313871] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2796.314258] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2801.315577] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2801.316036] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2806.316768] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2806.317218] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2811.318248] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2811.318672] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2816.318896] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2816.319184] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2821.319648] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2821.320136] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2826.320448] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2826.320707] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2831.321684] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2831.322183] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2836.323238] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2836.323710] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2841.324787] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2841.324787] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2846.325913] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2846.326310] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2851.326856] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2851.326856] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2856.328088] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2856.328497] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2861.329662] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2861.332093] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2866.331296] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2866.331804] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2871.332949] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2871.332949] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2876.333867] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2876.334313] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2881.334930] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2881.335398] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2886.335769] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2886.336233] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2891.337395] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2891.337395] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2896.338078] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2896.338078] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2901.339058] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2901.339517] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2906.340344] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2906.340344] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2911.341056] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2911.341826] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2916.342777] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2916.342777] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2921.343695] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2921.344139] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2926.344311] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2926.344752] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2931.345463] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2931.345463] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2936.345954] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2936.346430] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2941.346770] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2941.346770] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2946.348134] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2946.348528] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2951.349156] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2951.349897] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2956.351295] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2956.351793] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2961.352491] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2961.352872] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2966.094221] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:9 completed [ 2966.094655] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:10 started [ 2966.353210] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2966.353385] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2971.354135] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2971.354549] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2972.037025] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2972.037262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2972.037314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2972.037603] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2972.037720] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2972.540253] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2973.043567] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 2973.545844] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2973.546268] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2974.349342] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2974.349663] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2974.349663] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2974.349799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2974.362111] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2974.362956] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2974.363640] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2974.385410] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2974.385657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2974.385737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2974.385939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2974.386043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2974.386154] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 2974.386226] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2974.386295] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2974.407618] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2974.407870] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2974.407870] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2974.408025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2974.408162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2974.408281] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2974.429470] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2974.429696] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2974.429696] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2974.429874] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2974.429981] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2974.430108] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2974.451465] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2974.451617] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2974.451703] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2974.451922] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2974.452034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2974.452231] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 2974.452231] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2974.452319] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2974.474300] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2974.474474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2974.474529] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2974.474695] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2974.474780] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2974.474887] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2974.474955] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2974.475036] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2974.497246] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2974.497472] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2974.497472] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2974.497652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2974.497758] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2974.497875] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2974.497948] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 2974.498026] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2974.498092] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 2974.498163] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 2974.498222] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2974.498281] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2974.498350] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 2974.498407] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 2974.498470] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2974.519441] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2974.519677] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2974.519677] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2974.519853] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2974.519959] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2974.520089] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2974.539975] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2974.540205] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 2974.540205] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 2974.540397] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 2974.540496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2974.553849] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 2976.355143] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2976.355532] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2981.356219] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2981.356683] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2986.357366] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2986.357762] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2991.358403] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2991.358854] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2996.359231] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2996.359231] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3001.360783] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3001.360783] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3006.362125] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3006.362554] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3011.363754] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3011.363754] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3016.364533] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3016.364987] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3021.365828] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3021.366249] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3026.367506] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3026.367506] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3031.368875] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3031.368875] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3036.369904] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3036.370679] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3041.371912] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3041.372346] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3046.373901] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3046.373901] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3051.375049] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3051.375511] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3056.375646] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3056.376042] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3061.376609] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3061.377062] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3066.378102] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3066.378489] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3071.379715] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3071.380203] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3076.380576] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3076.381071] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3081.381663] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3081.382138] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3086.383019] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3086.383019] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3091.384582] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3091.384582] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3096.385762] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3096.386189] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3101.386738] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3101.387186] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3106.388691] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3106.388691] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3111.389518] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3111.389891] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3116.390327] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3116.390750] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3121.392062] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3121.392062] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3126.393572] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3126.394276] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3131.395755] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3131.396224] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3136.396413] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3136.396859] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3141.398171] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3141.398630] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3146.398786] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3146.399211] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3151.399940] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3151.400386] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3156.401598] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3156.401997] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3161.403733] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3161.403733] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3166.404901] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3166.404901] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3171.405976] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3171.406416] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3176.406988] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3176.406988] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3181.408532] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3181.408954] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3186.409539] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3186.409984] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3191.410543] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3191.410945] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3196.411406] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3196.411895] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3201.412498] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3201.412817] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3206.095699] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:10 completed [ 3206.096131] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:11 started [ 3206.413909] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3206.414152] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3211.414988] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3211.414988] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3212.036059] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3212.036059] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3212.036059] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3212.036059] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3212.036059] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3212.539343] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3213.042077] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3213.544332] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 3213.544717] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 3214.338696] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3214.339041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3214.339041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3214.339205] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3214.351420] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 3214.352460] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3214.353280] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 3214.373201] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3214.373555] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3214.373742] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3214.375061] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3214.375061] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3214.375061] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 3214.375061] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3214.375061] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 3214.394333] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3214.394632] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3214.394848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3214.395197] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3214.395451] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3214.395651] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 3214.414180] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3214.414492] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3214.414648] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3214.414956] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3214.415183] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3214.416370] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 3214.437057] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3214.437057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3214.437057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3214.437057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3214.437332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3214.437332] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 3214.437390] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3214.437420] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 3214.453543] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3214.453903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3214.454120] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3214.455058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3214.455058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3214.455058] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 3214.455058] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3214.455058] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 3214.475470] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3214.475801] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3214.475967] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3214.476264] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3214.476477] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3214.476677] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 3214.476842] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3214.477023] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 3214.478681] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 3214.478681] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 3214.478681] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 3214.478681] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 3214.478681] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 3214.478681] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 3214.478681] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 3214.496234] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3214.496558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3214.496740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3214.497046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3214.497251] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3214.497449] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 3214.515318] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3214.515707] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3214.515874] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3214.516185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3214.516386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3214.527630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3216.416392] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3216.417168] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3221.418137] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3221.418534] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3226.419548] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3226.420046] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3231.420942] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3231.421375] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3236.421830] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3236.422465] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3241.423313] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3241.423745] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3246.424168] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3246.424553] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3251.425254] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3251.425254] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3256.425794] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3256.426218] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3261.426701] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3261.427131] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3266.427582] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3266.427582] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3271.428034] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3271.428506] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3276.429299] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3276.430056] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3281.430736] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3281.551560] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3286.553386] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3286.553386] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3291.554252] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3291.554683] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3296.555682] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3296.557397] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3301.556550] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3301.556931] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3306.557292] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3306.557698] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3311.558500] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3311.560558] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3316.559474] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3316.559933] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3321.560957] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3321.560957] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3326.561848] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3326.562346] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3331.562597] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3331.563105] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3336.564252] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3336.565091] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3341.566474] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3341.566885] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3346.567352] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3346.567771] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3351.568468] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3351.568468] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3356.569271] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3356.570878] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3361.572186] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3361.572551] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3366.573024] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3366.573422] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3371.574384] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3371.574586] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3376.575650] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3376.576099] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3381.577077] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3381.577487] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3386.578653] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3386.579088] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3391.579392] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3391.579805] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3396.580910] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3396.581689] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3401.583135] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3401.583609] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3406.583911] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3406.584347] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3411.585484] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3411.585484] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3416.585967] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3416.586406] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3421.587245] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3421.587670] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3426.589160] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3426.589547] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3431.590759] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3431.591045] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3436.592422] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3436.592961] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3441.594284] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3441.594649] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3446.097427] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:11 completed [ 3446.097842] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:12 started [ 3446.595434] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3446.595638] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3451.596676] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3451.596676] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3452.040071] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3452.040071] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3452.040339] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3452.040528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3452.040669] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3452.543431] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3453.045841] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3453.548524] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 3453.548761] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 3454.289588] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3454.290033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3454.290033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3454.290033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3454.302517] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 3454.303381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3454.304064] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 3454.326919] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3454.327151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3454.327151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3454.327353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3454.327433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3454.327554] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 3454.327621] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3454.327688] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 3454.347270] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3454.347437] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3454.347499] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3454.347657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3454.347789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3454.347901] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 3454.368024] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3454.368225] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3454.368267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3454.368449] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3454.368552] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3454.368659] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 3454.392046] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3454.392232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3454.392272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3454.392448] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3454.392548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3454.392662] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 3454.392730] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3454.392797] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 3454.411286] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3454.411445] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3454.411499] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3454.411658] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3454.411740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3454.411844] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 3454.411914] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3454.411975] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 3454.431492] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3454.431694] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3454.431694] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3454.431864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3454.431964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3454.432089] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 3454.432171] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3454.432229] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 3454.432287] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 3454.432338] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 3454.432388] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 3454.432447] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 3454.432516] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 3454.432569] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 3454.432628] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 3454.451244] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3454.451390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3454.451442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3454.451619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3454.451717] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3454.451821] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 3454.470876] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3454.471055] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3454.471099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3454.471263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3454.471358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3454.483509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3456.598221] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3456.598668] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3461.599970] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3461.600388] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3466.601209] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3466.601967] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3471.603176] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3471.603641] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3476.604492] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3476.604877] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3481.605450] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3481.605823] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3486.606577] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3486.606994] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3491.607761] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3491.608134] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3496.609264] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3496.609715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3501.611223] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3501.611946] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3506.612738] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3506.613201] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3511.614680] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3511.616101] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3516.616082] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3516.616482] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3521.617128] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3521.617577] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3526.618427] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3526.618937] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3531.619712] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3531.620108] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3536.620984] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3536.620984] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3541.622372] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3541.622372] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3546.623952] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3546.624733] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3551.625685] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3551.626125] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3556.627221] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3556.627707] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3561.628873] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3561.629341] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3566.630121] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3566.630489] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3571.631378] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3571.631843] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3576.633117] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3576.633117] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3581.634178] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3581.634178] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3586.635969] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3586.635969] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3591.637262] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3591.637707] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3596.638781] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3596.639238] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3601.640388] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3601.640754] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3606.642252] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3606.642626] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3611.643854] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3611.644217] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3616.645557] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3616.645557] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3621.646485] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3621.646864] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3626.648189] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3626.648189] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3631.649931] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3631.650382] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3636.650896] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3636.650896] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3641.651722] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3641.652167] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3646.653500] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3646.655711] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3651.655066] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3651.655497] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3656.656305] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3656.656741] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3661.657743] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3661.657743] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3666.659104] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3666.659104] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3671.660454] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3671.660454] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3676.661147] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3676.661562] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3681.662332] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3681.662721] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3686.098919] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:12 completed [ 3686.099373] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:13 started [ 3686.663802] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3686.663982] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3691.665023] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3691.665458] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3692.044460] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3692.044697] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3692.044748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3692.044980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3692.045103] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3692.548049] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3693.050483] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3693.552867] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 3693.553102] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 3694.436946] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3694.437468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3694.437468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3694.437468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3694.449563] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 3694.450417] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3694.451182] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 3694.472348] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3694.472530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3694.472530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3694.472746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3694.472833] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3694.472945] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 3694.473024] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3694.473092] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 3694.497064] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3694.497248] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3694.497314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3694.497475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3694.497613] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3694.497727] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 3694.524201] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3694.524394] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3694.524394] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3694.524603] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3694.524705] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3694.524819] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 3694.550326] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3694.550518] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3694.550518] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3694.550730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3694.550834] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3694.550955] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 3694.551039] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3694.551108] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 3694.570125] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3694.570308] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3694.570362] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3694.570539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3694.570618] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3694.570727] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 3694.570801] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3694.570900] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 3694.591940] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3694.592211] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3694.592211] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3694.592353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3694.592455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3694.592566] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 3694.592636] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3694.592700] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 3694.592762] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 3694.592832] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 3694.592890] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 3694.592945] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 3694.593025] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 3694.593077] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 3694.593140] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 3694.614418] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3694.614638] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3694.614638] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3694.614807] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3694.614911] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3694.615034] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 3694.636203] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3694.636418] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3694.636418] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3694.636596] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3694.636695] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3694.649537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3696.666418] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3696.666794] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3701.667955] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3701.667955] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3706.668871] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3706.669379] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3711.669563] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3711.669953] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3716.670708] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3716.671159] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3721.672036] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3721.672553] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3726.673739] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3726.674160] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3731.674806] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3731.675199] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3736.676107] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3736.676837] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3741.677845] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3741.678302] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3746.679114] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3746.679597] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3751.680067] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3751.680479] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3756.681780] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3756.681780] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3761.682754] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3761.683287] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3766.683666] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3766.684075] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3771.684606] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3771.685048] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3776.685804] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3776.686240] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3781.687080] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3781.687080] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3786.687994] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3786.688392] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3791.689315] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3791.689763] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3796.690545] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3796.690970] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3801.691598] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3801.691987] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3806.692700] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3806.692700] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3811.693825] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3811.695456] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3816.695068] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3816.695581] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3821.697078] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3821.697078] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3826.698536] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3826.698536] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3831.699767] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3831.701281] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3836.701128] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3836.701128] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3841.702396] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3841.702792] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3846.704215] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3846.704215] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3851.705417] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3851.705417] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3856.707025] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3856.707458] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3861.708457] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3861.708838] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3866.709621] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3866.709621] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3871.710798] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3871.710798] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3876.712141] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3876.712141] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3881.713141] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3881.713141] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3886.714765] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3886.715203] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3891.716356] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3891.716356] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3896.716925] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3896.716925] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3901.717910] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3901.717910] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3906.719131] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3906.719131] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3911.720900] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3911.722881] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3916.722728] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3916.722728] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3921.724118] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3921.724118] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3926.100060] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:13 completed [ 3926.100471] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:14 started [ 3926.724628] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3926.724843] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3931.726388] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3931.726819] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3932.040972] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3932.042058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3932.042058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3932.042058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3932.042058] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3932.544515] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3933.046752] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 3933.549569] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 3933.549782] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 3934.308924] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3934.309350] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3934.309350] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3934.309350] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3934.321996] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 3934.322870] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3934.323660] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 3934.343581] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3934.343806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3934.343806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3934.344039] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3934.344143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3934.344223] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 3934.344223] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3934.344397] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 3934.364524] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3934.364777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3934.364777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3934.364978] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3934.365086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3934.365171] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 3934.384664] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3934.384879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3934.384879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3934.385085] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3934.385163] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3934.385261] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 3934.405258] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3934.405510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3934.405510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3934.405655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3934.405757] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3934.405875] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 3934.405945] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3934.406021] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 3934.422854] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3934.423073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3934.423073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3934.423262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3934.423346] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3934.423453] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 3934.423521] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3934.423589] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 3934.444943] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3934.445155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3934.445155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3934.445353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3934.445453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3934.445570] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 3934.445642] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 3934.445707] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 3934.445772] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 3934.445849] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 3934.445945] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 3934.446022] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 3934.446116] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 3934.446198] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 3934.446269] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 3934.470366] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3934.470643] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3934.470643] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3934.470790] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3934.470874] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3934.470986] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 3934.492635] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 3934.492903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 3934.492903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 3934.493058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 3934.493167] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3934.505113] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 3936.728108] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3936.728583] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3941.730039] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3941.730429] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3946.731480] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3946.731897] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3951.732895] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3951.733352] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3956.733652] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3956.734149] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3961.735178] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3961.735544] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3966.736916] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3966.737331] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3971.738402] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3971.738842] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3976.739895] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3976.740368] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3981.741420] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3981.741420] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3986.742117] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3986.742117] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3991.743584] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3991.743964] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 3996.744664] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 3996.744664] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4001.745621] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4001.745621] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4006.746422] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4006.746802] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4011.748069] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4011.748069] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4016.748824] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4016.749292] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4021.750077] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4021.750508] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4026.751139] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4026.751139] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4031.752225] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4031.752677] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4036.753206] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4036.753605] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4041.754596] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4041.754596] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4046.756091] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4046.756534] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4051.757808] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4051.758230] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4056.758664] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4056.759082] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4061.759988] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4061.759988] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4066.761249] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4066.762066] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4071.762893] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4071.762893] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4076.764115] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4076.764530] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4081.764786] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4081.765381] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4086.766078] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4086.766078] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4091.766839] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4091.766839] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4096.768387] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4096.768856] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4101.769330] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4101.769775] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4106.770213] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4106.770642] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4111.771917] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4111.772406] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4116.773473] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4116.773914] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4121.774381] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4121.774748] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4126.775491] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4126.775959] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4131.776263] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4131.776683] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4136.777801] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4136.778223] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4141.779028] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4141.779410] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4146.780051] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4146.780051] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4151.780868] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4151.781338] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4156.781826] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4156.782290] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4161.783274] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4161.783673] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4166.101046] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:14 completed [ 4166.101512] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:15 started [ 4166.784418] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4166.786199] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4171.785916] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4171.785916] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4172.047072] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4172.047072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4172.047072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4172.047427] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4172.047427] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4172.550453] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4173.054324] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4173.556484] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 4173.556696] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 4174.288770] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4174.289202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4174.289202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4174.289285] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4174.302351] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 4174.303701] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4174.304697] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 4174.327875] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4174.328107] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4174.328162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4174.328431] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4174.328546] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4174.328692] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 4174.328786] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4174.328880] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 4174.347758] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4174.347945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4174.347945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4174.348166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4174.348302] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4174.348414] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 4174.368539] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4174.368751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4174.368751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4174.368945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4174.369023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4174.369134] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 4174.388913] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4174.389137] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4174.389137] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4174.389345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4174.389468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4174.389551] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 4174.389628] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4174.389686] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 4174.408225] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4174.408400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4174.408400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4174.408603] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4174.408684] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4174.408783] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 4174.408850] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4174.408918] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 4174.427924] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4174.428137] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4174.428137] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4174.428319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4174.428421] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4174.428535] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 4174.428604] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4174.428668] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 4174.428729] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 4174.428800] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 4174.428860] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 4174.428919] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 4174.428986] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 4174.429052] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 4174.429116] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 4174.448255] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4174.448437] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4174.448437] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4174.448643] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4174.448746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4174.448857] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 4174.468305] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4174.468506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4174.468506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4174.468685] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4174.468785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4174.489520] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4176.786713] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4176.787158] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4181.788682] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4181.788682] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4186.789957] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4186.790424] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4191.791155] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4191.791585] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4196.792432] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4196.792887] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4201.793708] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4201.794244] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4206.795507] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4206.795910] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4211.796853] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4211.797283] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4216.798390] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4216.798790] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4221.800147] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4221.800629] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4226.801078] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4226.801478] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4231.802417] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4231.802886] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4236.803531] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4236.803977] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4241.804896] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4241.805343] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4246.806442] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4246.806862] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4251.807971] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4251.808387] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4256.809521] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4256.809521] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4261.810655] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4261.811141] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4266.812728] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4266.812728] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4271.814099] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4271.814371] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4276.815060] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4276.815903] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4281.816940] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4281.817332] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4286.818399] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4286.818789] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4291.820330] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4291.820729] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4296.821790] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4296.821790] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4301.822934] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4301.823620] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4306.824512] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4306.824893] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4311.825909] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4311.826373] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4316.827435] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4316.827839] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4321.829095] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4321.829497] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4326.830315] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4326.830734] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4331.832117] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4331.832495] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4336.833178] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4336.833593] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4341.834948] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4341.835682] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4346.836689] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4346.837196] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4351.838088] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4351.838502] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4356.839886] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4356.840377] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4361.841068] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4361.841472] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4366.842793] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4366.843188] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4371.843735] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4371.844126] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4376.844747] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4376.845250] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4381.846552] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4381.846981] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4386.847670] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4386.847670] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4391.848415] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4391.848834] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4396.849578] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4396.850414] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4401.851317] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4401.851653] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4406.103144] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:15 completed [ 4406.103538] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:16 started [ 4406.852230] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4406.852454] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4411.853020] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4411.853356] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4412.050991] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4412.051252] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4412.051303] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4412.051538] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4412.051645] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4412.553948] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4413.057214] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4413.559956] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 4413.560181] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 4414.361176] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4414.361608] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4414.361608] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4414.361608] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4414.373790] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 4414.374611] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4414.375309] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 4414.404021] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4414.404218] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4414.404292] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4414.404475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4414.404555] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4414.404663] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 4414.404783] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4414.404783] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 4414.425091] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4414.425283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4414.425340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4414.425598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4414.425759] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4414.425902] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 4414.444395] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4414.444576] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4414.444576] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4414.444777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4414.444879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4414.444992] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 4414.478023] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4414.478291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4414.478348] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4414.478542] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4414.478646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4414.478768] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 4414.478831] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4414.478892] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 4414.498820] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4414.499049] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4414.499049] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4414.499226] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4414.499314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4414.499426] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 4414.499495] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4414.499561] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 4414.518890] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4414.519113] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4414.519113] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4414.519322] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4414.519421] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4414.519539] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 4414.519610] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4414.519674] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 4414.519736] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 4414.519807] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 4414.519865] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 4414.519921] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 4414.519989] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 4414.520058] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 4414.520120] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 4414.540703] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4414.540874] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4414.540909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4414.541110] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4414.541217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4414.541323] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 4414.559916] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4414.560106] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4414.560106] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4414.560271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4414.560368] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4414.571867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4416.853833] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4416.854239] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4421.855544] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4421.855544] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4426.856646] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4426.857152] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4431.857475] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4431.857940] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4436.858744] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4436.859141] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4441.860412] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4441.860412] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4446.861311] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4446.861816] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4451.862605] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4451.863032] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4456.864064] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4456.864064] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4461.865395] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4461.865858] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4466.867074] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4466.867490] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4471.868040] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4471.868454] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4476.869660] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4476.869660] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4481.870646] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4481.871165] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4486.871318] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4486.871715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4491.872787] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4491.873195] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4496.874278] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4496.874825] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4501.875215] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4501.875653] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4506.876196] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4506.876645] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4511.877338] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4511.877764] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4516.878543] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4516.878543] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4521.879031] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4521.879462] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4526.880188] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4526.880681] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4531.881438] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4531.881718] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4536.882376] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4536.882795] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4541.883640] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4541.884129] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4546.884535] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4546.886589] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4551.886073] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4551.886498] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4556.886948] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4556.887370] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4561.888741] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4561.888741] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4566.890545] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4566.890965] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4571.892459] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4571.892871] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4576.893561] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4576.893934] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4581.895032] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4581.895474] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4586.896328] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4586.896761] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4591.897938] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4591.898453] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4596.899791] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4596.900272] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4601.901383] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4601.901872] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4606.903335] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4606.903849] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4611.904963] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4611.905498] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4616.906444] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4616.906888] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4621.907990] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4621.908483] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4626.909559] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4626.909965] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4631.910910] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4631.911382] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4636.912454] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4636.916193] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4641.914484] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4641.914900] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4646.103924] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:16 completed [ 4646.104268] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:17 started [ 4646.915476] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4646.915710] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4651.916400] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4651.916797] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4652.053527] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4652.053751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4652.053751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4652.053997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4652.054107] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4652.556264] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4653.058763] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4653.560958] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 4653.561209] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 4654.299639] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4654.300077] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4654.300077] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4654.300314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4654.312630] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 4654.313431] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4654.314146] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 4654.331736] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4654.331916] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4654.331983] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4654.332161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4654.332245] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4654.332355] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 4654.332423] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4654.332495] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 4654.350236] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4654.350385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4654.350385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4654.350559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4654.350689] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4654.350797] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 4654.369620] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4654.369806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4654.369806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4654.370009] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4654.370123] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4654.370233] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 4654.389266] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4654.389453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4654.389499] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4654.389672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4654.389773] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4654.389887] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 4654.389958] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4654.390036] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 4654.406621] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4654.406782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4654.406831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4654.407020] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4654.407108] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4654.407218] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 4654.407287] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4654.407357] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 4654.425912] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4654.426096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4654.426141] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4654.426304] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4654.426402] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4654.426518] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 4654.426589] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4654.426655] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 4654.426731] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 4654.426820] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 4654.426883] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 4654.426944] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 4654.427024] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 4654.427081] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 4654.427146] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 4654.469979] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4654.470192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4654.470256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4654.470421] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4654.470533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4654.470681] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 4654.489547] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4654.489754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4654.489754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4654.489940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4654.490052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4654.502901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4656.917863] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4656.918301] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4661.919503] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4661.919884] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4666.921146] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4666.921589] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4671.922199] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4671.922618] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4676.923404] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4676.923404] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4681.924519] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4681.925165] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4686.926218] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4686.926638] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4691.927555] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4691.927936] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4696.929251] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4696.930037] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4701.931109] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4701.931603] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4706.932824] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4706.933252] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4711.934778] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4711.934778] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4716.935619] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4716.936125] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4721.937174] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4721.937580] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4726.938436] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4726.938436] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4731.939188] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4731.939726] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4736.940573] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4736.941070] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4741.941629] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4741.942100] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4746.943353] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4746.943806] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4751.945178] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4751.945632] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4756.947057] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4756.947057] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4761.948454] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4761.948454] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4766.950025] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4766.950441] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4771.951623] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4771.952532] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4776.953819] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4776.954231] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4781.955485] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4781.955485] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4786.956899] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4786.956899] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4791.958336] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4791.958336] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4796.959493] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4796.959991] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4801.960613] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4801.961106] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4806.961406] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4806.961827] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4811.962909] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4811.962909] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4816.964399] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4816.964784] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4821.965430] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4821.965839] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4826.967139] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4826.967575] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4831.968666] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4831.969170] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4836.969552] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4836.969933] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4841.970482] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4841.970946] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4846.971430] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4846.971852] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4851.972518] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4851.972975] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4856.974320] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4856.974320] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4861.975473] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4861.975990] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4866.976520] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4866.976953] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4871.977736] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4871.977736] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4876.978445] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4876.978445] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4881.979189] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4881.979647] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4886.104647] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:17 completed [ 4886.105068] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:18 started [ 4886.980168] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4886.980380] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4891.981623] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4891.982065] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4892.054479] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4892.054751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4892.054751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4892.055027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4892.055160] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4892.557501] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4893.059973] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 4893.562964] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 4893.563184] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 4894.308517] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4894.308811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4894.308811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4894.308942] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4894.321884] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 4894.322830] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4894.323787] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 4894.347466] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4894.347676] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4894.347676] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4894.347859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4894.347944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4894.348079] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 4894.348152] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4894.348222] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 4894.369730] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4894.369927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4894.369927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4894.370137] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4894.370278] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4894.370391] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 4894.392357] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4894.392618] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4894.392618] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4894.392742] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4894.392850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4894.392999] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 4894.413150] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4894.413395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4894.413395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4894.413535] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4894.413639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4894.413756] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 4894.413826] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4894.413893] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 4894.431161] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4894.431356] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4894.431356] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4894.431560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4894.431646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4894.431755] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 4894.431830] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4894.431892] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 4894.454728] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4894.455026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4894.455026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4894.455297] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4894.455491] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4894.455686] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 4894.455827] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 4894.455962] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 4894.456101] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 4894.456266] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 4894.456310] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 4894.456367] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 4894.456445] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 4894.456503] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 4894.456569] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 4894.477293] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4894.477522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4894.477522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4894.477700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4894.477805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4894.477917] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 4894.500393] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 4894.500604] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 4894.500604] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 4894.500779] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 4894.500880] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4894.513044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 4896.982877] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4896.983266] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4901.984302] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4901.984716] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4906.985423] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4906.985845] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4911.986901] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4911.987364] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4916.987781] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4916.988238] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4921.989386] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4921.989817] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4926.990317] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4926.992662] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4931.992110] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4931.992110] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4936.993240] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4936.993669] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4941.994741] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4941.995240] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4946.996169] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4946.996550] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4951.997916] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4951.997916] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4956.999637] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4956.999997] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4962.001128] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4962.001348] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4967.002665] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4967.003106] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4972.004545] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4972.004960] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4977.005614] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4977.006152] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4982.007663] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4982.008079] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4987.009554] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4987.009554] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4992.010944] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4992.010944] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 4997.012667] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 4997.012667] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5002.013846] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5002.014316] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5007.015138] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5007.015855] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5012.017345] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5012.017816] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5017.019013] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5017.019424] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5022.020419] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5022.020852] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5027.022450] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5027.022450] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5032.023568] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5032.024062] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5037.024669] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5037.025166] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5042.027094] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5042.027094] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5047.028141] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5047.028542] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5052.029376] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5052.029376] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5057.030366] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5057.031150] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5062.032443] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5062.032962] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5067.033821] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5067.034276] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5072.034854] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5072.035293] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5077.036665] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5077.037167] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5082.038347] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5082.038347] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5087.039607] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5087.040075] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5092.040784] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5092.041260] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5097.042304] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5097.042760] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5102.044132] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5102.045086] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5107.046396] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5107.046819] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5112.047959] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5112.047959] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5117.049285] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5117.049732] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5122.050426] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5122.050855] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5126.106120] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:18 completed [ 5126.106120] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:19 started [ 5127.050990] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5127.051228] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5132.052776] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5132.053229] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5132.054358] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5132.055058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5132.055058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5132.055058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5132.055292] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5132.557678] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5133.060994] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5133.563392] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 5133.563601] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 5134.368785] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5134.369256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5134.369256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5134.369256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5134.381707] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 5134.382546] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5134.383301] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 5134.405295] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5134.405471] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5134.405547] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5134.405709] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5134.405792] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5134.405899] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 5134.405990] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5134.406115] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 5134.426938] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5134.427202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5134.427202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5134.427465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5134.427619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5134.427738] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 5134.450435] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5134.450647] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5134.450647] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5134.450839] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5134.450940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5134.451068] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 5134.473904] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5134.474124] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5134.474124] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5134.474316] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5134.474420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5134.474539] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 5134.474608] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5134.474677] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 5134.492939] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5134.493151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5134.493151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5134.493364] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5134.493450] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5134.493556] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 5134.493626] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5134.493693] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 5134.515156] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5134.515358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5134.515358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5134.515559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5134.515663] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5134.515774] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 5134.515845] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5134.515917] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 5134.515977] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 5134.516078] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 5134.516140] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 5134.516197] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 5134.516270] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 5134.516322] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 5134.516384] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 5134.535282] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5134.535444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5134.535530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5134.535727] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5134.535832] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5134.535939] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 5134.556517] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5134.556753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5134.556753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5134.556915] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5134.557024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5134.567649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5137.054454] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5137.054904] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5142.055282] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5142.055741] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5147.057039] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5147.057039] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5152.058112] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5152.058552] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5157.059532] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5157.059948] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5162.061068] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5162.061068] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5167.062448] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5167.062831] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5172.063835] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5172.064559] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5177.066315] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5177.066315] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5182.067792] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5182.068262] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5187.068692] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5187.068692] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5192.069495] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5192.069495] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5197.071059] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5197.071488] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5202.072480] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5202.072877] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5207.073686] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5207.074149] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5212.075202] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5212.075650] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5217.076018] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5217.076450] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5222.077430] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5222.077941] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5227.078451] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5227.078942] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5232.079471] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5232.079906] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5237.081048] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5237.081743] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5242.083497] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5242.083497] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5247.084072] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5247.084072] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5252.085050] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5252.085459] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5257.086062] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5257.086477] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5262.087271] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5262.087989] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5267.089067] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5267.089440] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5272.090586] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5272.090586] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5277.091919] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5277.092350] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5282.093205] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5282.093760] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5287.094377] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5287.094843] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5292.095487] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5292.095913] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5297.097084] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5297.097492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5302.098123] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5302.098566] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5307.099288] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5307.099656] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5312.100357] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5312.100357] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5317.101645] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5317.102097] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5322.103162] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5322.103582] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5327.104536] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5327.104943] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5332.105863] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5332.106277] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5337.106745] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5337.107179] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5342.107521] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5342.108148] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5347.109259] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5347.109643] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5352.110423] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5352.110933] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5357.112192] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5357.112456] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5362.113461] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5362.113955] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5366.106844] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:19 completed [ 5366.107390] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:20 started [ 5367.114189] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5367.114570] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5372.060060] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5372.060060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5372.060060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5372.060060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5372.060060] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5372.115157] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5372.115505] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5372.563064] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5373.065256] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5373.568063] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 5373.568311] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 5374.300065] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5374.300065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5374.300065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5374.300065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5374.312047] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 5374.313044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5374.313973] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 5374.333584] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5374.333972] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5374.334209] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5374.334510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5374.334688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5374.335926] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 5374.335926] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5374.335926] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 5374.353501] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5374.353811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5374.353990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5374.354295] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5374.354521] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5374.354715] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 5374.374240] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5374.374634] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5374.374821] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5374.375129] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5374.375336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5374.376094] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 5374.397427] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5374.397834] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5374.398017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5374.398332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5374.398545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5374.400022] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 5374.400022] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5374.400022] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 5374.416095] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5374.416407] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5374.416583] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5374.416867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5374.417063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5374.417258] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 5374.417433] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5374.417605] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 5374.436062] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5374.436388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5374.436556] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5374.436834] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5374.437051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5374.437264] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 5374.438048] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5374.438048] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 5374.438048] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 5374.438048] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 5374.438048] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 5374.438048] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 5374.438048] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 5374.438048] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 5374.438048] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 5374.454909] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5374.455234] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5374.455392] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5374.455657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5374.455848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5374.456058] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 5374.474975] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5374.476153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5374.476153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5374.476153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5374.476153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5374.486158] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5377.117408] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5377.117788] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5382.119046] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5382.119462] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5387.120573] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5387.120981] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5392.122274] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5392.122737] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5397.123727] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5397.124108] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5402.125660] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5402.125660] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5407.126991] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5407.127737] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5412.129027] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5412.129454] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5417.130478] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5417.131312] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5422.133207] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5422.133207] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5427.133865] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5427.134315] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5432.135313] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5432.135313] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5437.136994] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5437.137421] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5442.138053] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5442.138443] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5447.139905] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5447.140289] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5452.141148] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5452.141598] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5457.142677] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5457.143154] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5462.144299] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5462.144299] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5467.145655] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5467.145655] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5472.147267] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5472.147685] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5477.149236] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5477.149655] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5482.150986] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5482.151440] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5487.152193] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5487.152614] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5492.153292] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5492.153770] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5497.154404] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5497.154831] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5502.156265] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5502.156265] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5507.157410] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5507.157410] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5512.158438] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5512.158879] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5517.159607] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5517.160160] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5522.161229] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5522.161720] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5527.163015] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5527.163416] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5532.164373] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5532.164736] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5537.165948] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5537.165948] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5542.167127] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5542.167545] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5547.168290] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5547.168773] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5552.169785] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5552.170273] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5557.171340] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5557.171697] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5562.173067] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5562.173067] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5567.173903] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5567.173903] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5572.175211] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5572.175662] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5577.176770] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5577.177207] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5582.177703] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5582.178201] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5587.178667] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5587.178667] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5592.180249] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5592.180666] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5597.181681] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5597.182129] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5602.182582] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5602.183040] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5606.107703] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:20 completed [ 5606.108208] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:21 started [ 5607.183565] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5607.183930] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5612.057686] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5612.058180] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5612.058180] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5612.058180] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5612.058387] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5612.184495] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5612.184697] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5612.561747] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5613.064202] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5613.566837] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 5613.567062] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 5614.346531] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5614.347092] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5614.347092] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5614.347092] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5614.359803] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 5614.360634] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5614.361361] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 5614.381729] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5614.381913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5614.381974] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5614.382161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5614.382246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5614.382358] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 5614.382429] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5614.382495] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 5614.403422] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5614.403629] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5614.403687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5614.403856] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5614.403984] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5614.404110] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 5614.424044] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5614.424241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5614.424241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5614.424475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5614.424580] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5614.424696] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 5614.445642] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5614.445851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5614.445851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5614.446076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5614.446178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5614.446409] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 5614.446409] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5614.446519] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 5614.464905] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5614.465072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5614.465199] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5614.465301] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5614.465384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5614.465491] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 5614.465563] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5614.465631] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 5614.484651] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5614.484867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5614.484867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5614.485081] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5614.485189] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5614.485329] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 5614.485401] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5614.485530] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 5614.485579] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 5614.485651] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 5614.485709] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 5614.485773] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 5614.485864] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 5614.485918] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 5614.485983] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 5614.510482] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5614.510672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5614.510713] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5614.510965] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5614.511089] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5614.511205] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 5614.530466] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5614.530668] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5614.530668] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5614.530837] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5614.530939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5614.542928] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5617.185917] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5617.186364] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5622.187349] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5622.187777] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5627.188966] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5627.188966] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5632.190077] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5632.190488] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5637.191569] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5637.191569] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5642.192951] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5642.193495] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5647.194499] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5647.194879] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5652.195707] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5652.196133] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5657.196468] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5657.196875] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5662.197560] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5662.198041] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5667.198560] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5667.198560] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5672.199826] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5672.199826] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5677.200691] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5677.200691] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5682.202361] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5682.202818] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5687.203203] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5687.203864] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5692.204917] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5692.205405] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5697.206075] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5697.206075] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5702.206833] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5702.207278] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5707.207749] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5707.208162] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5712.208967] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5712.209404] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5717.209760] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5717.209760] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5722.211014] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5722.211364] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5727.212353] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5727.212767] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5732.214019] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5732.214441] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5737.215804] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5737.216229] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5742.217548] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5742.217962] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5747.219026] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5747.219676] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5752.220601] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5752.221085] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5757.221560] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5757.222103] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5762.222721] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5762.223275] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5767.224600] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5767.224996] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5772.226085] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5772.226553] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5777.228026] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5777.228519] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5782.229259] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5782.229653] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5787.230142] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5787.230462] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5792.231690] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5792.232169] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5797.232387] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5797.232770] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5802.234071] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5802.234071] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5807.234884] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5807.235176] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5812.236454] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5812.236925] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5817.237410] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5817.237410] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5822.238927] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5822.238927] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5827.239922] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5827.240422] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5832.241071] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5832.241071] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5837.242091] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5837.242519] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5842.243203] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5842.243637] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5846.108918] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:21 completed [ 5846.109346] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:22 started [ 5847.244863] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5847.245271] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5852.054684] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5852.055145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5852.055145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5852.055283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5852.055283] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5852.245805] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5852.246096] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5852.557431] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5853.059536] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 5853.561831] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 5853.562061] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 5854.464953] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5854.465435] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5854.465435] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5854.465435] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5854.478410] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 5854.479251] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5854.480017] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 5854.500732] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5854.500948] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5854.500948] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5854.501164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5854.501249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5854.501358] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 5854.501429] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5854.501498] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 5854.521570] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5854.521755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5854.521755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5854.521953] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5854.522102] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5854.522218] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 5854.545958] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5854.546198] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5854.546198] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5854.546380] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5854.546482] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5854.546590] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 5854.565527] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5854.565723] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5854.565723] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5854.565926] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5854.566047] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5854.566185] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 5854.566258] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5854.566335] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 5854.585140] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5854.585384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5854.585384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5854.585574] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5854.585656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5854.585840] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 5854.585929] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5854.585996] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 5854.606859] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5854.607176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5854.607176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5854.607326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5854.607400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5854.607501] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 5854.607583] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 5854.607651] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 5854.607727] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 5854.607791] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 5854.607855] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 5854.607855] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 5854.607946] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 5854.607990] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 5854.608054] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 5854.628717] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5854.628912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5854.628912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5854.629114] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5854.629220] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5854.629331] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 5854.650036] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 5854.650246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 5854.650246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 5854.650443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 5854.650545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5854.663366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 5857.246610] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5857.247109] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5862.248346] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5862.248773] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5867.250037] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5867.250442] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5872.251417] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5872.251845] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5877.252514] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5877.252514] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5882.253405] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5882.253825] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5887.255225] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5887.255605] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5892.256623] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5892.257417] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5897.258362] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5897.258724] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5902.259774] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5902.260218] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5907.260808] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5907.261253] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5912.262218] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5912.262669] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5917.263936] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5917.264740] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5922.265729] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5922.265729] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5927.267177] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5927.267639] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5932.268798] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5932.268798] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5937.270302] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5937.270686] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5942.271196] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5942.271668] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5947.272803] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5947.273289] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5952.274395] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5952.274817] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5957.275428] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5957.275841] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5962.276970] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5962.276970] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5967.278053] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5967.278497] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5972.279138] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5972.279895] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5977.280764] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5977.281612] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5982.282744] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5982.282744] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5987.284230] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5987.284711] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5992.285774] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5992.285774] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 5997.287184] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 5997.287699] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6002.288380] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6002.288820] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6007.290075] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6007.290478] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6012.291662] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6012.292108] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6017.293140] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6017.293497] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6022.294119] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6022.294574] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6027.295601] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6027.296069] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6032.296443] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6032.296864] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6037.297287] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6037.297736] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6042.298388] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6042.298773] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6047.299253] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6047.299668] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6052.300746] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6052.300746] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6057.302100] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6057.302468] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6062.303544] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6062.304055] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6067.304400] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6067.304811] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6072.305413] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6072.305884] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6077.306792] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6077.307282] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6082.307928] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6082.308362] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6086.110019] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:22 completed [ 6086.110419] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:23 started [ 6087.309300] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6087.309524] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6092.054376] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6092.054824] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6092.054824] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6092.054901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6092.055079] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6092.310177] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6092.310409] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6092.558489] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6093.061144] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6093.564109] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 6093.564337] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 6094.296427] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6094.296924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6094.296924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6094.296924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6094.309167] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 6094.310027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6094.310689] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 6094.330558] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6094.330771] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6094.330847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6094.331015] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6094.331145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6094.331260] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 6094.331331] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6094.331394] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 6094.351569] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6094.351781] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6094.351781] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6094.351949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6094.352097] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6094.352208] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 6094.372863] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6094.373092] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6094.373092] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6094.373271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6094.373375] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6094.373484] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 6094.391965] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6094.392167] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6094.392221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6094.392377] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6094.392474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6094.392587] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 6094.392658] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6094.392756] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 6094.409774] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6094.409955] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6094.410030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6094.410221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6094.410300] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6094.410407] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 6094.410477] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6094.410544] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 6094.432162] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6094.432378] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6094.432378] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6094.432567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6094.432666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6094.432784] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 6094.432855] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6094.432920] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 6094.432982] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 6094.433064] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 6094.433125] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 6094.433184] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 6094.433254] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 6094.433310] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 6094.433372] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 6094.451767] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6094.451934] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6094.451976] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6094.452165] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6094.452328] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6094.452371] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 6094.472595] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6094.472793] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6094.472793] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6094.472973] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6094.473089] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6094.483563] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6097.311089] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6097.311089] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6102.312446] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6102.312446] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6107.313844] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6107.314247] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6112.315442] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6112.315442] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6117.316561] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6117.316993] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6122.318449] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6122.318882] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6127.320201] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6127.320609] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6132.322168] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6132.322603] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6137.323906] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6137.323906] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6142.325076] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6142.325589] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6147.326794] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6147.326794] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6152.328506] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6152.328506] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6157.330137] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6157.330526] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6162.331108] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6162.331840] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6167.333491] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6167.333896] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6172.334728] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6172.335139] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6177.336504] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6177.336504] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6182.337868] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6182.337868] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6187.339171] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6187.339602] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6192.340608] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6192.341095] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6197.342179] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6197.342645] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6202.343598] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6202.343944] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6207.344479] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6207.344897] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6212.345429] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6212.345819] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6217.347344] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6217.347344] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6222.348612] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6222.349564] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6227.351139] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6227.351542] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6232.352520] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6232.352898] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6237.354117] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6237.354489] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6242.355318] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6242.355738] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6247.356832] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6247.357354] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6252.358397] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6252.358397] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6257.359120] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6257.359550] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6262.360618] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6262.361095] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6267.361797] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6267.362367] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6272.363423] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6272.363423] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6277.364336] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6277.364752] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6282.365390] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6282.365833] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6287.367394] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6287.367394] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6292.368243] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6292.368737] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6297.369725] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6297.370216] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6302.371150] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6302.371633] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6307.372897] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6307.373365] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6312.373798] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6312.374272] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6317.375450] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6317.375450] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6322.376291] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6322.376679] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6326.111133] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:23 completed [ 6326.111604] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:24 started [ 6327.377412] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6327.377814] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6332.055344] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6332.057072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6332.057072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6332.057072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6332.057072] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6332.378992] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6332.378992] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6332.560064] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6333.063064] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6333.565383] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 6333.565604] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 6334.449724] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6334.450203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6334.450203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6334.450203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6334.462595] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 6334.463430] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6334.464207] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 6334.483441] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6334.483625] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6334.483625] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6334.483837] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6334.483922] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6334.484083] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 6334.484127] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6334.484187] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 6334.504197] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6334.504391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6334.504391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6334.504588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6334.504749] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6334.504868] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 6334.526123] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6334.526324] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6334.526324] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6334.526534] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6334.526636] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6334.526743] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 6334.545332] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6334.545533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6334.545576] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6334.545772] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6334.545875] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6334.545989] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 6334.546096] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6334.546143] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 6334.563555] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6334.563758] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6334.563818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6334.563989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6334.564099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6334.564204] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 6334.564275] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6334.564344] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 6334.583080] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6334.583264] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6334.583341] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6334.583561] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6334.583722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6334.583829] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 6334.583905] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6334.583957] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 6334.584022] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 6334.584084] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 6334.584138] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 6334.584193] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 6334.584262] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 6334.584314] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 6334.584377] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 6334.612191] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6334.612428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6334.612428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6334.612580] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6334.612712] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6334.612824] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 6334.631088] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6334.631275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6334.631275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6334.631468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6334.631566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6334.642825] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6337.379970] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6337.380848] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6342.381932] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6342.382365] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6347.383545] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6347.383928] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6352.384727] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6352.385286] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6357.385870] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6357.386264] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6362.387550] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6362.387550] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6367.388465] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6367.388465] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6372.389457] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6372.389457] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6377.390443] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6377.390443] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6382.391161] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6382.391582] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6387.392579] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6387.392579] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6392.394166] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6392.394673] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6397.395157] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6397.395572] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6402.397090] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6402.397514] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6407.398067] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6407.398451] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6412.399437] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6412.399437] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6417.400091] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6417.400517] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6422.401539] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6422.402135] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6427.402329] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6427.402684] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6432.403373] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6432.403373] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6437.404815] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6437.404815] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6442.405703] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6442.406139] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6447.407338] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6447.407758] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6452.408269] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6452.408697] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6457.409645] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6457.410441] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6462.411907] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6462.411907] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6467.412619] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6467.412619] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6472.413560] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6472.413991] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6477.414219] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6477.414631] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6482.415701] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6482.416198] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6487.416766] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6487.417306] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6492.418319] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6492.418748] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6497.419932] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6497.420398] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6502.421094] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6502.421492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6507.422425] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6507.422829] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6512.424362] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6512.424782] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6517.426329] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6517.426772] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6522.427765] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6522.428226] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6527.429180] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6527.429609] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6532.430348] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6532.430797] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6537.431376] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6537.431745] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6542.432883] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6542.433341] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6547.434024] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6547.434460] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6552.435075] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6552.435495] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6557.436267] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6557.436659] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6562.437516] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6562.437915] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6566.112763] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:24 completed [ 6566.113247] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:25 started [ 6567.438806] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6567.439236] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6572.054332] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6572.054775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6572.054775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6572.054850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6572.054976] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6572.439828] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6572.440114] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6572.557817] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6573.060718] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6573.562753] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 6573.562947] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 6574.308111] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6574.308539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6574.308539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6574.308539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6574.321227] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 6574.322125] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6574.322822] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 6574.342853] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6574.343057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6574.343057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6574.343271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6574.343355] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6574.343468] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 6574.343548] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6574.343625] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 6574.363303] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6574.363529] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6574.363529] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6574.363687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6574.363817] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6574.363929] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 6574.385390] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6574.385594] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6574.385594] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6574.385780] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6574.385882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6574.385992] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 6574.403865] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6574.404067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6574.404067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6574.404268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6574.404369] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6574.404482] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 6574.404554] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6574.404624] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 6574.421486] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6574.421678] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6574.421678] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6574.421853] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6574.421933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6574.422050] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 6574.422121] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6574.422192] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 6574.441334] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6574.441518] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6574.441518] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6574.441700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6574.441799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6574.441913] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 6574.441984] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6574.442062] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 6574.442126] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 6574.442196] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 6574.442254] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 6574.442315] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 6574.442384] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 6574.442435] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 6574.442499] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 6574.460754] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6574.460921] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6574.460958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6574.461147] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6574.461255] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6574.461361] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 6574.479367] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6574.479583] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6574.479583] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6574.479743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6574.479842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6574.491152] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6577.441525] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6577.441949] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6582.443132] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6582.443633] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6587.444764] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6587.445175] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6592.446513] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6592.446513] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6597.448327] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6597.448327] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6602.450463] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6602.450463] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6607.452189] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6607.452621] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6612.453699] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6612.454094] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6617.455402] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6617.456155] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6622.457865] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6622.458289] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6627.459288] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6627.459691] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6632.460662] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6632.460662] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6637.461443] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6637.461867] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6642.462655] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6642.463452] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6647.464444] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6647.464896] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6652.466241] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6652.466673] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6657.467798] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6657.467798] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6662.469118] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6662.469545] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6667.470893] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6667.471415] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6672.472363] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6672.472776] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6677.474146] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6677.474528] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6682.475578] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6682.475987] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6687.476667] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6687.477114] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6692.478497] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6692.478963] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6697.479643] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6697.480172] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6702.480812] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6702.481195] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6707.482476] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6707.482857] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6712.483911] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6712.483911] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6717.485421] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6717.485421] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6722.486984] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6722.487466] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6727.488101] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6727.488580] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6732.489577] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6732.489951] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6737.491323] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6737.491703] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6742.493060] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6742.493356] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6747.494616] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6747.495073] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6752.496277] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6752.496673] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6757.497886] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6757.498337] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6762.499702] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6762.499702] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6767.500485] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6767.500866] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6772.501864] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6772.502306] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6777.503014] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6777.503426] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6782.503926] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6782.503926] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6787.505803] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6787.505803] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6792.506774] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6792.507227] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6797.508216] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6797.508569] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6802.509387] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6802.509668] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6806.114169] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:25 completed [ 6806.114566] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:26 started [ 6807.510570] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6807.510955] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6812.053054] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6812.053054] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6812.053054] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6812.053054] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6812.053054] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6812.511681] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6812.511867] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6812.556275] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6813.058433] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 6813.560869] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 6813.561215] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 6814.354025] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6814.354465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6814.354465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6814.354465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6814.367069] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 6814.367698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6814.368422] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 6814.388586] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6814.388861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6814.388861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6814.389042] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6814.389042] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6814.389154] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 6814.389243] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6814.389314] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 6814.408799] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6814.409101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6814.409101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6814.409268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6814.409346] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6814.409433] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 6814.427689] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6814.427926] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6814.427926] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6814.428086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6814.428189] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6814.428293] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 6814.448356] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6814.448542] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6814.448542] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6814.448729] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6814.448831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6814.448944] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 6814.449024] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6814.449093] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 6814.465339] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6814.465488] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6814.465488] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6814.465661] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6814.465743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6814.465847] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 6814.465915] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6814.465978] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 6814.485462] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6814.485688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6814.485688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6814.485827] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6814.485947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6814.486080] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 6814.486152] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 6814.486218] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 6814.486281] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 6814.486353] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 6814.486417] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 6814.486468] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 6814.486537] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 6814.486587] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 6814.486651] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 6814.506164] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6814.506340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6814.506378] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6814.506551] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6814.506654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6814.506763] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 6814.525058] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 6814.525257] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 6814.525257] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 6814.525455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 6814.525558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6814.536226] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 6817.512653] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6817.513193] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6822.513420] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6822.513814] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6827.514659] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6827.515047] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6832.515794] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6832.516216] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6837.516401] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6837.516819] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6842.518062] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6842.518473] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6847.519110] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6847.519110] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6852.520580] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6852.520580] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6857.521533] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6857.522196] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6862.523399] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6862.523763] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6867.524409] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6867.524409] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6872.525074] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6872.525472] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6877.526396] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6877.526856] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6882.528354] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6882.529086] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6887.530513] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6887.530954] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6892.531912] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6892.532337] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6897.533065] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6897.533065] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6902.534810] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6902.534810] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6907.536283] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6907.536690] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6912.538276] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6912.538672] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6917.540099] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6917.540499] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6922.541492] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6922.541905] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6927.542705] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6927.543211] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6932.544311] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6932.544679] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6937.546202] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6937.546651] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6942.548516] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6942.548516] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6947.550029] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6947.550436] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6952.551629] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6952.551629] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6957.553083] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6957.553083] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6962.554311] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6962.554762] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6967.555436] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6967.555899] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6972.556973] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6972.556973] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6977.558337] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6977.558699] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6982.559595] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6982.560108] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6987.561060] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6987.561060] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6992.562584] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6992.563052] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 6997.564508] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 6997.564508] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7002.565864] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7002.566425] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7007.567317] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7007.567741] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7012.569109] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7012.569513] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7017.570340] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7017.570811] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7022.572041] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7022.572452] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7027.573833] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7027.574230] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7032.575297] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7032.575692] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7037.576223] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7037.576604] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7042.578010] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7042.578403] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7046.115894] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:26 completed [ 7046.116388] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:27 started [ 7047.579883] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7047.580451] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7052.057214] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7052.057702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7052.057702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7052.057781] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7052.057868] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7052.561068] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7052.580748] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7052.580748] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7053.064063] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7053.566221] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 7053.566429] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 7054.355682] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7054.356127] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7054.356127] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7054.356127] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7054.368923] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 7054.369750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7054.370507] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 7054.388815] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7054.389027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7054.389027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7054.389228] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7054.389355] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7054.389410] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 7054.389481] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7054.389552] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 7054.408736] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7054.408968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7054.408968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7054.409145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7054.409278] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7054.409388] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 7054.430715] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7054.430928] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7054.430928] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7054.431139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7054.431248] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7054.431360] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 7054.449350] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7054.449488] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7054.449556] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7054.449745] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7054.449845] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7054.449956] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 7054.450037] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7054.450105] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 7054.468151] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7054.468318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7054.468375] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7054.468544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7054.468627] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7054.468731] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 7054.468799] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7054.468867] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 7054.489958] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7054.490173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7054.490173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7054.490361] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7054.490461] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7054.490567] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 7054.490637] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7054.490701] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 7054.490762] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 7054.490833] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 7054.490889] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 7054.490948] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 7054.491085] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 7054.491085] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 7054.491157] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 7054.511678] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7054.511875] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7054.511875] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7054.512106] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7054.512210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7054.512322] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 7054.532894] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7054.533142] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7054.533142] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7054.533292] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7054.533392] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7054.544752] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7057.581638] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7057.582076] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7062.582897] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7062.583270] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7067.584393] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7067.584393] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7072.585336] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7072.585762] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7077.586479] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7077.587287] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7082.588670] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7082.589117] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7087.590222] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7087.590222] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7092.591241] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7092.591634] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7097.592150] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7097.592560] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7102.593386] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7102.593787] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7107.594767] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7107.595210] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7112.595552] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7112.596047] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7117.597251] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7117.597251] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7122.599393] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7122.599393] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7127.600735] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7127.601040] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7132.601946] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7132.602388] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7137.603270] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7137.603750] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7142.604799] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7142.605543] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7147.606483] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7147.606903] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7152.607610] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7152.608038] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7157.609118] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7157.609444] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7162.610660] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7162.611085] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7167.611466] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7167.611892] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7172.612374] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7172.612705] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7177.613786] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7177.614302] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7182.614446] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7182.614779] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7187.615112] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7187.615747] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7192.616934] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7192.617301] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7197.617891] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7197.618367] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7202.619414] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7202.619852] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7207.620705] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7207.621137] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7212.621354] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7212.621910] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7217.622813] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7217.623530] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7222.624419] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7222.624748] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7227.625364] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7227.625815] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7232.626584] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7232.626948] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7237.627454] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7237.627862] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7242.628342] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7242.628601] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7247.628974] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7247.629348] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7252.630091] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7252.630485] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7257.630732] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7257.631168] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7262.631799] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7262.631799] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7267.633187] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7267.633634] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7272.634598] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7272.635060] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7277.635874] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7277.636249] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7282.637409] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7282.637884] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7286.117393] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:27 completed [ 7286.117393] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:28 started [ 7287.638898] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7287.639314] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7292.056774] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7292.057226] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7292.057226] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7292.057298] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7292.057448] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7292.559915] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7292.639695] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7292.639944] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7293.062922] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7293.565716] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 7293.565933] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 7294.499947] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7294.500386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7294.500386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7294.500386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7294.512870] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 7294.513753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7294.514508] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 7294.534403] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7294.534597] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7294.534597] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7294.534742] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7294.534827] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7294.534939] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 7294.535017] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7294.535090] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 7294.556207] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7294.556388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7294.556388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7294.556610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7294.556737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7294.556848] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 7294.578362] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7294.578563] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7294.578563] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7294.578776] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7294.578880] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7294.578991] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 7294.600640] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7294.600849] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7294.600849] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7294.601046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7294.601155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7294.601276] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 7294.601347] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7294.601413] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 7294.620752] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7294.620943] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7294.621019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7294.621206] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7294.621290] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7294.621398] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 7294.621467] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7294.621536] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 7294.642270] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7294.642470] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7294.642549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7294.642750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7294.642894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7294.643054] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 7294.643129] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7294.643195] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 7294.643248] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 7294.643323] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 7294.643383] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 7294.643443] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 7294.643514] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 7294.643569] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 7294.643629] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 7294.666134] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7294.666335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7294.666335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7294.666548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7294.666629] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7294.666737] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 7294.690289] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7294.690431] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7294.690500] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7294.690704] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7294.690806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7294.702411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7297.641625] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7297.642078] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7302.643409] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7302.643844] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7307.644845] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7307.645336] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7312.646371] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7312.647085] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7317.648195] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7317.648665] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7322.650247] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7322.650798] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7327.651661] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7327.652133] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7332.653025] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7332.653514] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7337.654579] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7337.654579] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7342.655576] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7342.656090] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7347.657504] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7347.658257] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7352.659066] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7352.659066] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7357.659774] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7357.660267] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7362.661499] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7362.661947] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7367.663354] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7367.663354] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7372.664726] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7372.665135] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7377.665927] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7377.666397] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7382.667529] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7382.667529] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7387.668565] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7387.668954] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7392.669709] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7392.670147] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7397.670672] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7397.671101] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7402.672079] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7402.672491] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7407.672996] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7407.673457] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7412.674834] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7412.675342] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7417.676082] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7417.676507] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7422.677367] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7422.677840] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7427.678913] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7427.679298] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7432.679882] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7432.680314] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7437.681237] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7437.681668] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7442.682335] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7442.682821] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7447.683570] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7447.684368] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7452.685794] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7452.686242] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7457.687609] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7457.688105] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7462.688744] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7462.689212] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7467.690659] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7467.690659] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7472.692260] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7472.692260] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7477.693768] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7477.694181] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7482.695358] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7482.695771] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7487.696587] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7487.696987] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7492.697931] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7492.698348] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7497.699333] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7497.699333] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7502.701066] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7502.701066] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7507.701741] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7507.702200] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7512.702721] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7512.703143] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7517.703583] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7517.704293] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7522.705272] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7522.705719] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7526.118026] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:28 completed [ 7526.118026] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:29 started [ 7527.706715] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7527.706715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7532.054062] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7532.054062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7532.054062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7532.054062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7532.054062] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7532.555903] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7532.707184] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7532.707349] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7533.057831] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7533.560848] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 7533.561172] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 7534.401193] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7534.401590] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7534.401590] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7534.401590] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7534.413990] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 7534.414788] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7534.415618] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 7534.434718] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7534.434896] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7534.434954] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7534.435145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7534.435228] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7534.435339] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 7534.435410] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7534.435479] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 7534.454725] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7534.454900] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7534.454900] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7534.455127] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7534.455262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7534.455375] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 7534.476611] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7534.476811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7534.476811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7534.476997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7534.477118] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7534.477228] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 7534.498690] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7534.498893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7534.498893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7534.499148] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7534.499260] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7534.499380] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 7534.499452] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7534.499520] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 7534.519050] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7534.519244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7534.519244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7534.519436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7534.519522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7534.519632] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 7534.519697] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7534.519766] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 7534.540623] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7534.540847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7534.540847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7534.541042] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7534.541111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7534.541212] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 7534.541276] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7534.541341] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 7534.541430] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 7534.541515] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 7534.541576] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 7534.541636] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 7534.541708] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 7534.541770] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 7534.541817] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 7534.562582] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7534.562818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7534.562818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7534.562994] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7534.563116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7534.563227] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 7534.587692] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7534.587903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7534.587952] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7534.588170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7534.588291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7534.599774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7537.708205] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7537.708621] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7542.709307] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7542.709732] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7547.710938] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7547.710938] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7552.711789] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7552.711789] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7557.712777] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7557.713179] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7562.713720] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7562.714167] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7567.715565] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7567.715565] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7572.716451] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7572.716884] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7577.718060] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7577.718487] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7582.719657] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7582.719657] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7587.720884] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7587.720884] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7592.722328] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7592.722328] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7597.723811] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7597.723811] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7602.725130] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7602.725523] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7607.726391] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7607.726834] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7612.727716] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7612.728189] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7617.728838] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7617.729313] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7622.730226] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7622.730747] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7627.731324] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7627.731704] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7632.732674] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7632.733157] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7637.734283] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7637.734689] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7642.735993] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7642.735993] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7647.736872] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7647.736872] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7652.738215] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7652.738584] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7657.739554] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7657.740031] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7662.741299] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7662.741299] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7667.742675] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7667.744680] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7672.744343] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7672.744343] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7677.745947] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7677.746370] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7682.747044] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7682.747621] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7687.749353] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7687.749727] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7692.750518] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7692.750942] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7697.752176] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7697.752582] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7702.753298] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7702.753635] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7707.754626] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7707.755076] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7712.756407] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7712.756835] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7717.758190] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7717.758627] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7722.760229] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7722.760701] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7727.761968] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7727.762400] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7732.763140] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7732.763546] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7737.764310] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7737.764690] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7742.766291] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7742.766735] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7747.768105] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7747.768525] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7752.769194] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7752.769611] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7757.770704] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7757.771174] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7762.771968] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7762.772440] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7766.119664] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:29 completed [ 7766.120089] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:30 started [ 7767.772967] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7767.773404] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7772.051459] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7772.052087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7772.052087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7772.052087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7772.052087] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7772.555323] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7772.773927] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7772.774194] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7773.058524] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 7773.560811] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 7773.561161] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 7774.414382] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7774.414800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7774.414800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7774.414800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7774.427278] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 7774.428083] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7774.428813] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 7774.448142] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7774.448337] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7774.448337] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7774.448554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7774.448636] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7774.448742] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 7774.448812] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7774.448880] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 7774.467414] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7774.467593] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7774.467658] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7774.467825] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7774.467960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7774.468098] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 7774.488281] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7774.488480] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7774.488480] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7774.488684] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7774.488788] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7774.488898] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 7774.507702] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7774.507913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7774.507913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7774.508091] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7774.508195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7774.508311] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 7774.508380] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7774.508475] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 7774.524679] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7774.524833] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7774.524888] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7774.525079] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7774.525161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7774.525268] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 7774.525336] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7774.525402] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 7774.544348] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7774.544568] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7774.544568] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7774.544743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7774.544844] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7774.544961] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 7774.545048] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 7774.545119] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 7774.545184] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 7774.545257] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 7774.545321] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 7774.545383] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 7774.545456] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 7774.545516] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 7774.545582] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 7774.565482] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7774.565659] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7774.565659] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7774.565854] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7774.565958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7774.566084] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 7774.596137] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 7774.596363] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 7774.596363] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 7774.596564] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 7774.596670] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7774.608391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 7777.775902] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7777.776411] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7782.777252] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7782.777666] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7787.778691] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7787.779128] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7792.779635] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7792.780094] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7797.780937] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7797.781410] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7802.782762] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7802.782762] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7807.784314] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7807.784687] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7812.785598] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7812.786066] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7817.786603] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7817.786998] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7822.787638] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7822.788108] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7827.788779] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7827.789224] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7832.789963] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7832.790398] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7837.791254] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7837.791638] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7842.792543] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7842.792543] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7847.793838] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7847.794341] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7852.794828] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7852.795263] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7857.796343] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7857.796720] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7862.797608] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7862.798069] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7867.798625] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7867.799067] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7872.799498] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7872.799967] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7877.800312] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7877.800739] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7882.801707] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7882.801707] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7887.802549] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7887.803043] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7892.804218] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7892.805855] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7897.805890] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7897.806321] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7902.807608] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7902.808119] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7907.809164] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7907.809559] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7912.810100] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7912.810522] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7917.811058] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7917.811468] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7922.812343] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7922.812343] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7927.813973] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7927.814451] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7932.815056] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7932.815479] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7937.816308] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7937.816308] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7942.817650] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7942.818070] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7947.819283] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7947.819699] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7952.820963] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7952.820963] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7957.821800] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7957.821800] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7962.822517] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7962.822517] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7967.823167] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7967.823614] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7972.824293] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7972.824724] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7977.825469] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7977.825897] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7982.826289] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7982.827180] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7987.827954] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7987.828360] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7992.829286] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7992.829768] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 7997.830159] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 7997.830645] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8002.831187] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8002.831584] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8006.121785] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:30 completed [ 8006.122200] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:31 started [ 8007.832309] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8007.832715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8012.049621] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8012.050138] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8012.050138] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8012.050138] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8012.050314] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8012.552997] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8012.833743] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8012.833947] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8013.055593] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8013.557947] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 8013.558157] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 8014.304076] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8014.304501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8014.304501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8014.304501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8014.316813] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 8014.317613] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8014.318306] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 8014.336912] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8014.337108] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8014.337108] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8014.337315] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8014.337398] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8014.337507] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 8014.337578] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8014.337646] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 8014.355950] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8014.356165] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8014.356165] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8014.356373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8014.356543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8014.356677] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8014.376221] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8014.376399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8014.376439] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8014.376627] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8014.376741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8014.376860] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8014.398192] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8014.398394] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8014.398436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8014.398621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8014.398725] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8014.398843] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 8014.398918] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8014.398989] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 8014.417028] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8014.417247] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8014.417247] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8014.417423] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8014.417509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8014.417615] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 8014.417684] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8014.417753] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 8014.437649] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8014.437849] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8014.437849] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8014.438089] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8014.438199] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8014.438320] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 8014.438391] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8014.438456] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 8014.438519] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 8014.438590] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 8014.438646] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 8014.438708] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 8014.438773] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 8014.438828] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 8014.438885] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8014.458521] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8014.458712] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8014.458712] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8014.458910] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8014.459021] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8014.459133] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8014.477588] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8014.477785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8014.477785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8014.477962] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8014.478077] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8014.494787] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8017.834551] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8017.835043] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8022.835349] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8022.835740] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8027.836914] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8027.837619] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8032.838331] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8032.838702] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8037.839409] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8037.839824] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8042.840341] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8042.840745] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8047.841429] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8047.841822] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8052.842755] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8052.843202] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8057.844446] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8057.844956] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8062.845916] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8062.846370] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8067.847389] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8067.847789] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8072.848325] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8072.848790] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8077.850221] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8077.850660] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8082.851804] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8082.852325] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8087.853498] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8087.853869] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8092.855324] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8092.855790] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8097.856601] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8097.857064] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8102.858593] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8102.859215] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8107.860416] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8107.860843] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8112.862068] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8112.862516] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8117.863414] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8117.863836] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8122.864655] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8122.865199] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8127.866590] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8127.866590] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8132.867601] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8132.868063] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8137.869348] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8137.869770] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8142.870742] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8142.871197] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8147.871930] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8147.872379] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8152.873318] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8152.873775] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8157.875215] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8157.875695] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8162.876404] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8162.876404] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8167.877803] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8167.877803] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8172.879370] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8172.879370] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8177.880271] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8177.881039] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8182.882254] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8182.882595] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8187.883532] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8187.884030] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8192.884988] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8192.884988] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8197.886150] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8197.886622] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8202.887675] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8202.888123] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8207.889078] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8207.889078] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8212.890340] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8212.891114] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8217.892614] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8217.893102] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8222.894278] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8222.894870] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8227.895237] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8227.895951] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8232.897085] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8232.897085] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8237.897959] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8237.898718] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8242.899725] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8242.900503] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8246.124394] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:31 completed [ 8246.124711] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:32 started [ 8247.901729] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8247.902138] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8252.046166] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8252.046618] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8252.046618] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8252.046770] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8252.046834] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8252.549894] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8252.903244] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8252.903244] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8253.051875] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8253.554165] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 8253.554409] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 8254.322026] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8254.322554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8254.322554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8254.322789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8254.335210] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 8254.336017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8254.336783] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 8254.355642] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8254.355857] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8254.355857] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8254.356070] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8254.356154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8254.356268] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 8254.356337] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8254.356405] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 8254.376144] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8254.376354] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8254.376354] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8254.376598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8254.376735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8254.376851] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8254.396528] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8254.396750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8254.396750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8254.396914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8254.397035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8254.397152] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8254.416611] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8254.416816] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8254.416816] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8254.417018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8254.417126] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8254.417245] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 8254.417316] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8254.417384] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 8254.434357] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8254.434537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8254.434589] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8254.434772] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8254.434854] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8254.434957] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 8254.435042] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8254.435116] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 8254.455529] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8254.455730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8254.455730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8254.455924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8254.456038] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8254.456155] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 8254.456225] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8254.456290] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 8254.456353] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 8254.456423] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 8254.456511] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 8254.456584] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 8254.456645] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 8254.456691] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 8254.456758] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8254.476160] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8254.476367] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8254.476367] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8254.476579] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8254.476683] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8254.476792] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8254.494172] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8254.494367] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8254.494367] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8254.494574] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8254.494678] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8254.506019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8257.904914] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8257.906234] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8262.906311] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8262.906311] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8267.907297] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8267.907729] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8272.908416] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8272.908416] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8277.909328] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8277.909770] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8282.910635] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8282.911143] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8287.912528] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8287.912528] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8292.913735] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8292.913735] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8297.915360] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8297.915802] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8302.916337] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8302.916337] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8307.917545] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8307.917545] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8312.918404] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8312.918846] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8317.919794] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8317.920269] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8322.921268] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8322.921684] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8327.922259] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8327.922684] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8332.923050] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8332.923441] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8337.923817] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8337.924235] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8342.925085] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8342.925085] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8347.926445] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8347.926870] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8352.928022] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8352.928381] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8357.929437] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8357.929857] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8362.930976] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8362.931441] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8367.932205] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8367.932661] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8372.933093] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8372.933517] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8377.933763] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8377.934212] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8382.935032] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8382.935507] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8387.936784] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8387.936784] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8392.937669] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8392.938098] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8397.938408] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8397.938798] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8402.939378] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8402.939800] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8407.940259] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8407.940666] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8412.941879] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8412.941879] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8417.942957] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8417.943398] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8422.944623] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8422.945087] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8427.945792] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8427.946152] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8432.946691] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8432.947122] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8437.947582] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8437.947582] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8442.948827] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8442.949265] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8447.950600] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8447.950600] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8452.951663] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8452.951663] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8457.952858] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8457.953306] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8462.953933] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8462.954507] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8467.955535] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8467.956255] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8472.957687] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8472.957687] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8477.958983] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8477.959412] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8482.960416] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8482.960825] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8486.125707] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:32 completed [ 8486.126172] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:33 started [ 8487.961504] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8487.961860] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8492.047245] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8492.047746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8492.047746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8492.047746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8492.047881] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8492.550467] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8492.963016] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8492.963016] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8493.052768] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8493.555888] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 8493.556090] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 8494.295909] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8494.296333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8494.296333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8494.296333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8494.308704] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 8494.309552] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8494.310252] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 8494.329688] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8494.329848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8494.329906] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8494.330098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8494.330173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8494.330292] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 8494.330361] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8494.330429] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 8494.348885] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8494.349053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8494.349112] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8494.349297] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8494.349428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8494.349532] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8494.368754] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8494.368896] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8494.368946] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8494.369193] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8494.369301] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8494.369408] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8494.388667] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8494.388857] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8494.388857] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8494.389114] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8494.389216] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8494.389329] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 8494.389398] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8494.389464] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 8494.407332] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8494.407501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8494.407557] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8494.407728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8494.407810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8494.407916] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 8494.407985] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8494.408062] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 8494.428192] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8494.428374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8494.428374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8494.428568] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8494.428665] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8494.428777] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 8494.428845] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8494.428909] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 8494.428973] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 8494.429052] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 8494.429153] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 8494.429215] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 8494.429281] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 8494.429389] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 8494.429389] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8494.448520] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8494.448672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8494.448710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8494.448896] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8494.449012] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8494.449155] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8494.466830] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8494.467107] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8494.467107] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8494.467244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8494.467346] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8494.477754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8497.964534] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8497.964992] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8502.966169] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8502.966565] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8507.967842] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8507.967842] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8512.969666] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8512.970197] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8517.971025] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8517.971502] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8522.972145] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8522.972565] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8527.973663] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8527.974082] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8532.974945] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8532.975738] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8537.977017] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8537.977396] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8542.978618] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8542.979087] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8547.979381] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8547.979813] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8552.981235] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8552.981702] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8557.982740] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8557.983164] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8562.984343] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8562.984780] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8567.985689] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8567.986064] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8572.987505] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8572.987505] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8577.988127] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8577.988521] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8582.989966] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8582.990796] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8587.992070] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8587.992471] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8592.993023] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8592.993425] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8597.994827] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8597.994827] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8602.996579] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8602.997058] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8607.997335] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8607.997716] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8612.998330] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8612.998792] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8617.999901] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8617.999901] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8623.001568] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8623.001568] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8628.002746] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8628.003105] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8633.004226] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8633.004603] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8638.005353] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8638.005728] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8643.006348] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8643.006731] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8648.008066] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8648.008426] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8653.008852] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8653.009296] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8658.009695] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8658.009996] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8663.010988] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8663.011432] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8668.011922] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8668.012332] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8673.013502] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8673.014238] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8678.015073] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8678.015073] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8683.015881] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8683.016274] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8688.017421] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8688.017931] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8693.018468] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8693.018822] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8698.019438] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8698.019814] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8703.020434] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8703.020942] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8708.021776] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8708.022185] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8713.022960] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8713.022960] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8718.023503] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8718.024290] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8723.025200] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8723.025614] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8726.126412] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:33 completed [ 8726.126784] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:34 started [ 8728.026174] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8728.026624] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8732.048934] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8732.049430] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8732.049430] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8732.049517] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8732.049665] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8732.552453] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8733.027315] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8733.027561] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8733.054991] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8733.558106] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 8733.558106] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 8734.322456] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8734.322901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8734.322901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8734.322901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8734.335480] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 8734.336257] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8734.336990] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 8734.356562] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8734.356747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8734.356747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8734.356956] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8734.357050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8734.357161] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 8734.357230] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8734.357296] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 8734.376013] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8734.376224] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8734.376224] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8734.376425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8734.376556] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8734.376666] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8734.397555] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8734.397754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8734.397860] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8734.397996] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8734.398119] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8734.398231] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8734.416300] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8734.416505] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8734.416505] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8734.416679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8734.416782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8734.416898] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 8734.416969] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8734.417041] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 8734.434134] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8734.434302] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8734.434355] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8734.434550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8734.434632] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8734.434740] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 8734.434817] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8734.434865] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 8734.453293] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8734.453479] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8734.453479] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8734.453679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8734.453780] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8734.453893] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 8734.453961] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8734.454037] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 8734.454105] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 8734.454168] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 8734.454221] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 8734.454281] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 8734.454348] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 8734.454400] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 8734.454462] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8734.474577] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8734.474754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8734.474794] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8734.474966] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8734.475087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8734.475194] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8734.494953] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8734.495171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8734.495214] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8734.495399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8734.495497] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8734.507256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8738.028908] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8738.029397] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8743.030392] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8743.030767] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8748.032291] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8748.032291] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8753.033601] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8753.033601] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8758.034985] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8758.035424] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8763.036406] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8763.036406] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8768.037644] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8768.038151] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8773.039383] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8773.039383] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8778.040699] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8778.041101] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8783.041870] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8783.042308] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8788.043672] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8788.043672] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8793.044114] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8793.045627] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8798.045689] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8798.046095] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8803.046374] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8803.046840] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8808.047578] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8808.047940] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8813.048364] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8813.048822] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8818.049133] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8818.049546] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8823.051086] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8823.051086] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8828.052652] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8828.053162] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8833.053899] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8833.054345] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8838.055366] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8838.055366] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8843.056839] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8843.057267] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8848.057859] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8848.058341] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8853.059750] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8853.060188] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8858.061179] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8858.061594] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8863.063149] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8863.063585] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8868.064373] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8868.064749] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8873.065515] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8873.065919] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8878.068512] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8878.068975] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8883.070450] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8883.070450] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8888.072072] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8888.072542] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8893.073971] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8893.074458] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8898.075386] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8898.075840] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8903.076385] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8903.076902] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8908.077426] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8908.077426] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8913.079330] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8913.079330] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8918.080938] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8918.081388] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8923.082126] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8923.082573] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8928.083957] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8928.085311] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8933.085020] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8933.085467] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8938.086450] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8938.086927] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8943.088025] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8943.088406] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8948.089145] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8948.089870] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8953.090807] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8953.091263] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8958.092468] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8958.092933] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8963.093998] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8963.094479] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8966.127863] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:34 completed [ 8966.128350] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:35 started [ 8968.095069] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8968.095069] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8972.048781] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8972.049310] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8972.049310] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8972.049498] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8972.049612] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8972.552461] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8973.055088] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 8973.095702] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8973.096237] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8973.558164] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 8973.558406] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 8974.309631] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8974.310077] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8974.310077] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8974.310077] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8974.322821] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 8974.323655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8974.324393] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 8974.344045] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8974.344228] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8974.344291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8974.344510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8974.344596] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8974.344710] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 8974.344780] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8974.344847] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 8974.363602] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8974.363786] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8974.363885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8974.364101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8974.364233] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8974.364360] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8974.381967] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8974.382139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8974.382185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8974.382394] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8974.382498] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8974.382605] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8974.403124] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8974.403295] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8974.403333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8974.403510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8974.403612] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8974.403727] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 8974.403797] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8974.403865] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 8974.420398] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8974.420552] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8974.420609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8974.420789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8974.420869] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8974.420972] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 8974.421050] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8974.421122] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 8974.442466] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8974.442632] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8974.442669] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8974.442847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8974.442944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8974.443074] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 8974.443150] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 8974.443216] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 8974.443294] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 8974.443341] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 8974.443395] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 8974.443451] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 8974.443519] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 8974.443573] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 8974.443633] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 8974.462395] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8974.462550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8974.462586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8974.462777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8974.462874] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8974.462978] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 8974.480926] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 8974.481118] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 8974.481118] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 8974.481309] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 8974.481408] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8974.492531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 8978.097549] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8978.097980] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8983.098552] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8983.098964] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8988.100033] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8988.100402] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8993.101104] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8993.101532] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 8998.102310] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 8998.102696] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9003.103976] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9003.104426] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9008.105820] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9008.105820] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9013.106771] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9013.107232] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9018.108532] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9018.108913] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9023.109382] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9023.109853] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9028.110515] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9028.110515] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9033.111486] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9033.112088] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9038.113414] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9038.113414] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9043.114383] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9043.114750] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9048.115744] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9048.116188] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9053.116826] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9053.117267] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9058.118054] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9058.118478] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9063.119375] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9063.119809] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9068.120292] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9068.120770] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9073.122034] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9073.122454] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9078.123916] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9078.123916] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9083.125244] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9083.125699] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9088.126634] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9088.126634] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9093.127629] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9093.127629] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9098.128524] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9098.129030] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9103.130215] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9103.130667] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9108.131899] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9108.132549] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9113.133916] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9113.133916] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9118.134981] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9118.135425] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9123.136197] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9123.136878] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9128.137592] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9128.138046] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9133.138510] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9133.138950] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9138.140303] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9138.140303] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9143.140899] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9143.141336] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9148.141802] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9148.142317] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9153.143388] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9153.143775] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9158.144768] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9158.145236] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9163.145716] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9163.146162] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9168.147341] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9168.147765] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9173.148350] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9173.148760] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9178.149691] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9178.150127] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9183.150642] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9183.151123] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9188.151573] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9188.152100] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9193.152799] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9193.153270] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9198.153800] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9198.153800] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9203.154994] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9203.155459] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9206.128814] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:35 completed [ 9206.129278] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:36 started [ 9208.156760] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9208.157243] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9212.053907] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9212.054414] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9212.054414] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9212.054414] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9212.054519] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9212.557378] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9213.060488] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9213.158060] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9213.158240] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9213.563241] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 9213.563445] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 9214.333244] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9214.333727] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9214.333727] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9214.333727] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9214.346030] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 9214.346826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9214.347535] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 9214.365908] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9214.366091] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9214.366158] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9214.366358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9214.366446] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9214.366578] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 9214.366649] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9214.366719] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 9214.388018] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9214.388228] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9214.388228] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9214.388430] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9214.388562] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9214.388674] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 9214.407785] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9214.407954] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9214.408034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9214.408256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9214.408389] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9214.408518] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 9214.427613] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9214.427816] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9214.427816] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9214.427986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9214.428127] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9214.428240] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 9214.428310] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9214.428380] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 9214.445558] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9214.445709] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9214.445763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9214.445929] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9214.446029] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9214.446142] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 9214.446223] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9214.446316] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 9214.464956] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9214.465135] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9214.465178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9214.465347] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9214.465447] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9214.465558] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 9214.465628] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9214.465693] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 9214.465757] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 9214.465828] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 9214.465888] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 9214.465948] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 9214.466028] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 9214.466088] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 9214.466151] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 9214.487152] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9214.487308] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9214.487360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9214.487543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9214.487647] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9214.487758] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 9214.505685] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9214.505871] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9214.505871] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9214.506069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9214.506173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9214.517035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9218.160133] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9218.160522] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9223.161707] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9223.162155] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9228.163626] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9228.163626] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9233.164655] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9233.165219] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9238.165469] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9238.165942] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9243.167411] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9243.167798] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9248.168525] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9248.168961] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9253.169846] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9253.169846] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9258.171710] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9258.172080] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9263.173082] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9263.173525] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9268.173909] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9268.174384] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9273.174664] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9273.175104] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9278.176352] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9278.176769] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9283.177386] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9283.177854] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9288.178593] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9288.178981] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9293.180254] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9293.180678] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9298.181062] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9298.181575] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9303.183055] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9303.183055] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9308.183942] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9308.184451] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9313.185041] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9313.185495] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9318.186230] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9318.186608] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9323.187419] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9323.187847] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9328.188621] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9328.189140] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9333.189897] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9333.190332] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9338.191550] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9338.191969] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9343.192776] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9343.194490] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9348.193992] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9348.194397] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9353.195472] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9353.195985] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9358.196318] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9358.196782] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9363.197800] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9363.198214] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9368.199344] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9368.199821] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9373.200396] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9373.200836] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9378.201233] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9378.201681] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9383.202202] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9383.202627] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9388.203413] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9388.203846] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9393.205049] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9393.205049] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9398.206646] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9398.207168] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9403.207890] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9403.208376] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9408.209558] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9408.209856] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9413.210741] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9413.211236] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9418.211733] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9418.212194] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9423.212675] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9423.213247] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9428.213417] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9428.213838] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9433.214680] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9433.215153] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9438.215528] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9438.215823] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9443.217285] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9443.217715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9446.129598] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:36 completed [ 9446.129996] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:37 started [ 9448.218312] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9448.218793] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9452.058220] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9452.059882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9452.059882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9452.059882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9452.059882] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9452.562084] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9453.064352] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9453.219539] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9453.219786] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9453.566262] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 9453.566527] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 9454.374065] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9454.374481] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9454.374481] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9454.374556] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9454.387675] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 9454.388705] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9454.389673] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 9454.409456] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9454.411544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9454.411544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9454.411544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9454.411544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9454.411544] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 9454.411544] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9454.411544] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 9454.430161] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9454.430332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9454.430332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9454.430518] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9454.430658] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9454.431024] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 9454.450617] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9454.451066] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9454.451162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9454.452639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9454.452639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9454.452639] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 9454.470069] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9454.470069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9454.470069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9454.470069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9454.470069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9454.470486] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 9454.470486] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9454.470486] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 9454.486790] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9454.487139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9454.487323] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9454.487604] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9454.488525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9454.488525] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 9454.488525] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9454.488525] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 9454.507627] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9454.507992] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9454.508178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9454.508456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9454.508665] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9454.508873] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 9454.509046] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9454.509193] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 9454.509355] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 9454.510075] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 9454.510075] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 9454.510075] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 9454.510075] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 9454.510075] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 9454.510075] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 9454.530182] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9454.530522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9454.530678] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9454.530989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9454.532028] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9454.532028] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 9454.549905] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9454.550287] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9454.550451] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9454.550734] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9454.550950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9454.562636] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9458.221259] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9458.221259] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9463.222337] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9463.222337] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9468.223777] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9468.223777] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9473.224994] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9473.225386] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9478.226597] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9478.226985] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9483.227568] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9483.228969] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9488.228338] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9488.228782] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9493.229744] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9493.231413] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9498.230995] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9498.231438] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9503.232399] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9503.232866] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9508.233699] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9508.233699] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9513.234598] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9513.234598] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9518.235470] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9518.235879] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9523.237017] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9523.237471] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9528.238572] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9528.238945] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9533.240170] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9533.240691] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9538.241065] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9538.241603] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9543.242234] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9543.242616] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9548.242858] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9548.243326] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9553.244377] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9553.244851] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9558.245835] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9558.245835] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9563.247192] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9563.247623] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9568.248736] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9568.248736] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9573.250108] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9573.250108] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9578.251709] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9578.251709] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9583.252841] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9583.253258] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9588.254077] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9588.254439] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9593.255473] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9593.255473] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9598.259064] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9598.259064] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9603.260876] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9603.260876] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9608.262523] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9608.262938] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9613.263651] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9613.264076] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9618.265097] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9618.265582] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9623.266405] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9623.266787] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9628.267494] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9628.267977] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9633.268992] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9633.269401] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9638.270853] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9638.271396] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9643.272736] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9643.273224] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9648.274503] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9648.274906] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9653.275630] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9653.276053] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9658.276957] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9658.277407] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9663.278710] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9663.279150] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9668.280452] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9668.280876] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9673.281914] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9673.281914] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9678.283647] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9678.283647] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9683.285060] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9683.286226] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9686.130867] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:37 completed [ 9686.131396] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:38 started [ 9688.286539] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9688.288296] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9692.054130] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9692.054649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9692.054649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9692.054649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9692.054766] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9692.557770] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9693.060641] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9693.287740] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9693.291995] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9693.563387] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 9693.563558] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 9694.320329] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9694.320755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9694.320755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9694.320832] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9694.334165] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 9694.335070] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9694.335701] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 9694.356564] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9694.356754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9694.356754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9694.356966] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9694.357062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9694.357172] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 9694.357241] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9694.357309] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 9694.376572] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9694.376780] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9694.376780] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9694.376957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9694.377100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9694.377210] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 9694.397945] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9694.398162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9694.398205] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9694.398427] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9694.398548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9694.398662] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 9694.420187] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9694.420384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9694.420384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9694.420578] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9694.420683] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9694.420818] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 9694.420890] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9694.420959] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 9694.443430] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9694.443644] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9694.443644] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9694.443854] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9694.443937] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9694.444057] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 9694.444124] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9694.444193] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 9694.467809] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9694.468060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9694.468060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9694.468230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9694.468335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9694.468452] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 9694.468524] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9694.468588] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 9694.468650] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 9694.468721] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 9694.468782] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 9694.468832] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 9694.468895] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 9694.468948] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 9694.469016] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 9694.487628] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9694.487831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9694.487831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9694.488021] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9694.488133] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9694.488240] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 9694.506441] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9694.506641] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9694.506641] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9694.506825] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9694.506924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9694.519402] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9698.289268] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9698.289715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9703.290625] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9703.290625] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9708.291988] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9708.292367] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9713.293605] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9713.293605] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9718.294635] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9718.294996] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9723.295922] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9723.296394] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9728.297641] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9728.298072] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9733.298806] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9733.300564] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9738.300223] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9738.300625] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9743.301428] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9743.301845] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9748.302374] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9748.303259] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9753.303992] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9753.304468] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9758.305475] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9758.305475] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9763.306746] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9763.306746] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9768.307616] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9768.307616] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9773.309016] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9773.309447] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9778.310677] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9778.310677] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9783.311716] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9783.312036] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9788.313636] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9788.313636] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9793.314834] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9793.315165] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9798.316023] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9798.316459] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9803.317446] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9803.317872] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9808.319474] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9808.319994] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9813.320270] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9813.320697] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9818.321941] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9818.322266] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9823.323768] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9823.323768] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9828.325099] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9828.325453] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9833.326493] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9833.326911] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9838.327605] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9838.328126] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9843.328483] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9843.328922] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9848.329546] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9848.329546] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9853.330546] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9853.330546] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9858.331903] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9858.331903] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9863.333217] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9863.333658] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9868.334232] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9868.334668] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9873.335701] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9873.336116] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9878.336410] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9878.336930] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9883.337374] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9883.337751] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9888.338823] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9888.339234] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9893.339981] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9893.340406] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9898.341438] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9898.341858] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9903.342738] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9903.342738] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9908.343376] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9908.343805] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9913.344478] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9913.344478] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9918.345061] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9918.345478] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9923.346461] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9923.346880] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9926.131860] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:38 completed [ 9926.132331] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:39 started [ 9928.347729] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9928.348587] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9932.051056] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9932.051504] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9932.051504] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9932.051504] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9932.051622] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9932.554970] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9933.058317] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [ 9933.349291] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9933.349454] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9933.561563] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 9933.561874] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 9934.407483] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9934.407912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9934.407912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9934.408034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9934.420526] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 9934.421353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9934.422112] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 9934.440948] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9934.441140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9934.441202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9934.441381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9934.441488] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9934.441577] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 9934.441649] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9934.441721] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 9934.462632] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9934.462817] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9934.462877] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9934.463053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9934.463197] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9934.463314] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 9934.482993] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9934.483217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9934.483264] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9934.483442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9934.483548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9934.483661] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 9934.501929] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9934.502145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9934.502145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9934.502335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9934.502442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9934.502557] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 9934.502631] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9934.502703] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 9934.521728] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9934.521918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9934.521918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9934.522173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9934.522275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9934.522388] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 9934.522461] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9934.522531] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 9934.542726] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9934.542989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9934.542989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9934.543108] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9934.543202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9934.543324] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 9934.543398] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 9934.543466] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 9934.543531] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 9934.543606] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 9934.543669] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 9934.543732] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 9934.543802] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 9934.543860] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 9934.543925] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 9934.564656] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9934.564871] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9934.564871] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9934.565114] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9934.565223] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9934.565340] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 9934.583326] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 9934.583530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 9934.583530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 9934.583716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 9934.583819] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9934.594818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 9938.350671] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9938.351096] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9943.351841] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9943.352321] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9948.352820] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9948.353232] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9953.353742] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9953.354146] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9958.355429] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9958.355820] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9963.356587] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9963.356975] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9968.358331] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9968.358801] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9973.359984] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9973.360402] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9978.361894] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9978.362493] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9983.363862] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9983.364354] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9988.365591] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9988.366065] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9993.367545] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9993.367545] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 9998.369335] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 9998.369335] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10003.371070] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10003.371070] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10008.372255] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10008.372640] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10013.373395] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10013.373762] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10018.374376] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10018.374791] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10023.375846] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10023.376200] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10028.377800] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10028.378227] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10033.379269] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10033.379269] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10038.380691] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10038.381180] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10043.381850] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10043.382086] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10048.383578] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10048.383957] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10053.385466] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10053.385466] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10058.387066] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10058.387499] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10063.388231] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10063.388955] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10068.389822] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10068.390262] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10073.391196] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10073.391545] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10078.393124] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10078.393385] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10078.454121] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b7b68db4-4906-4dde-b4ea-e429bd832432 None None] Enqueued Resource ID: 1918dcdc-ba13-44c7-b2c2-3b3a88610c93 with Priority: HIGHEST for action port [10078.455331] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1918dcdc-ba13-44c7-b2c2-3b3a88610c93 with Priority: HIGHEST for action port [10078.455331] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-1918dcdc-ba13-44c7-b2c2-3b3a88610c93 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10078.455331] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1918dcdc-ba13-44c7-b2c2-3b3a88610c93" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10078.455331] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1918dcdc-ba13-44c7-b2c2-3b3a88610c93" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10078.455331] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1918dcdc-ba13-44c7-b2c2-3b3a88610c93" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10078.455331] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1918dcdc-ba13-44c7-b2c2-3b3a88610c93',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10078.640896] env[65939]: INFO networking_nsxv3.common.synchronization [None req-fefaf382-fb2a-4cab-8292-ccc5bea107ee None None] Enqueued Resource ID: bbfa9fee-fad7-4720-bc4d-4389ca9385d8 with Priority: HIGHEST for action port [10078.641813] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbfa9fee-fad7-4720-bc4d-4389ca9385d8 with Priority: HIGHEST for action port [10078.642461] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbfa9fee-fad7-4720-bc4d-4389ca9385d8 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10078.642668] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbfa9fee-fad7-4720-bc4d-4389ca9385d8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10078.642783] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbfa9fee-fad7-4720-bc4d-4389ca9385d8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10078.643078] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbfa9fee-fad7-4720-bc4d-4389ca9385d8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10078.643306] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbfa9fee-fad7-4720-bc4d-4389ca9385d8',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10078.958253] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1918dcdc-ba13-44c7-b2c2-3b3a88610c93 [10078.958651] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10078.959044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10078.959150] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10078.959436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10078.959525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10078.959652] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1918dcdc-ba13-44c7-b2c2-3b3a88610c93 already deleted. [10078.959745] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1918dcdc-ba13-44c7-b2c2-3b3a88610c93" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10079.146603] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbfa9fee-fad7-4720-bc4d-4389ca9385d8 [10079.149334] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10079.149334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10079.149334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10079.149501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10079.149538] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10079.149636] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbfa9fee-fad7-4720-bc4d-4389ca9385d8 already deleted. [10079.149712] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbfa9fee-fad7-4720-bc4d-4389ca9385d8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10079.179702] env[65939]: INFO networking_nsxv3.common.synchronization [None req-81a564a3-4c3f-44dc-a4d5-202bd3340242 None None] Enqueued Resource ID: 1c69ffd2-8943-4ae6-a52f-128956309463 with Priority: HIGHEST for action port [10079.179894] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c69ffd2-8943-4ae6-a52f-128956309463 with Priority: HIGHEST for action port [10079.180617] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c69ffd2-8943-4ae6-a52f-128956309463 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10079.181345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c69ffd2-8943-4ae6-a52f-128956309463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10079.181345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c69ffd2-8943-4ae6-a52f-128956309463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10079.181345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c69ffd2-8943-4ae6-a52f-128956309463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10079.181345] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c69ffd2-8943-4ae6-a52f-128956309463',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10079.342575] env[65939]: INFO networking_nsxv3.common.synchronization [None req-62ef1718-c744-40d4-a925-f26aa3ae9568 None None] Enqueued Resource ID: bd229861-2dba-484c-b323-0f4882e5ab14 with Priority: HIGHEST for action port [10079.343154] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd229861-2dba-484c-b323-0f4882e5ab14 with Priority: HIGHEST for action port [10079.343597] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd229861-2dba-484c-b323-0f4882e5ab14 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10079.343704] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd229861-2dba-484c-b323-0f4882e5ab14" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10079.343766] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd229861-2dba-484c-b323-0f4882e5ab14" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10079.344835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd229861-2dba-484c-b323-0f4882e5ab14" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10079.344835] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd229861-2dba-484c-b323-0f4882e5ab14',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10079.684544] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c69ffd2-8943-4ae6-a52f-128956309463 [10079.684806] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10079.685468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10079.685468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10079.685909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10079.686086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10079.686200] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c69ffd2-8943-4ae6-a52f-128956309463 already deleted. [10079.686447] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c69ffd2-8943-4ae6-a52f-128956309463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10079.851296] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd229861-2dba-484c-b323-0f4882e5ab14 [10079.851296] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10079.851296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10079.851296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10079.851296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10079.851296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10079.851296] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd229861-2dba-484c-b323-0f4882e5ab14 already deleted. [10079.851296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd229861-2dba-484c-b323-0f4882e5ab14" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10080.913731] env[65939]: INFO networking_nsxv3.common.synchronization [None req-71e52bde-06ab-4bfd-a0d0-6f3d7cc4abe8 None None] Enqueued Resource ID: f8df753e-26b9-4936-b9d4-517f6f584e78 with Priority: HIGHEST for action port [10080.914300] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8df753e-26b9-4936-b9d4-517f6f584e78 with Priority: HIGHEST for action port [10080.914612] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8df753e-26b9-4936-b9d4-517f6f584e78 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10080.914759] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8df753e-26b9-4936-b9d4-517f6f584e78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10080.914827] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8df753e-26b9-4936-b9d4-517f6f584e78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10080.915271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8df753e-26b9-4936-b9d4-517f6f584e78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10080.915271] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8df753e-26b9-4936-b9d4-517f6f584e78',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10081.089021] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ec33ce90-05cc-48be-b865-5887d1ceb548 None None] Enqueued Resource ID: c9ea3a89-dc86-43e0-b403-cf69fb98f50f with Priority: HIGHEST for action port [10081.089461] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9ea3a89-dc86-43e0-b403-cf69fb98f50f with Priority: HIGHEST for action port [10081.089759] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9ea3a89-dc86-43e0-b403-cf69fb98f50f taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10081.089887] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9ea3a89-dc86-43e0-b403-cf69fb98f50f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10081.089960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9ea3a89-dc86-43e0-b403-cf69fb98f50f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10081.090206] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9ea3a89-dc86-43e0-b403-cf69fb98f50f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10081.090387] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9ea3a89-dc86-43e0-b403-cf69fb98f50f',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10081.418806] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8df753e-26b9-4936-b9d4-517f6f584e78 [10081.418806] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10081.418806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10081.418806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10081.418806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10081.418806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10081.418806] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8df753e-26b9-4936-b9d4-517f6f584e78 already deleted. [10081.418806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8df753e-26b9-4936-b9d4-517f6f584e78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10081.529018] env[65939]: INFO networking_nsxv3.common.synchronization [None req-687cc4f5-44ae-4604-a020-9e419d4f2e65 None None] Enqueued Resource ID: 2f8cd488-a4c9-46fa-bc7e-72d6e03c581d with Priority: HIGHEST for action port [10081.529293] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8cd488-a4c9-46fa-bc7e-72d6e03c581d with Priority: HIGHEST for action port [10081.529864] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f8cd488-a4c9-46fa-bc7e-72d6e03c581d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10081.531601] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f8cd488-a4c9-46fa-bc7e-72d6e03c581d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10081.531601] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f8cd488-a4c9-46fa-bc7e-72d6e03c581d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10081.531601] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f8cd488-a4c9-46fa-bc7e-72d6e03c581d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10081.531601] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f8cd488-a4c9-46fa-bc7e-72d6e03c581d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10081.592562] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9ea3a89-dc86-43e0-b403-cf69fb98f50f [10081.592912] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10081.594239] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10081.594357] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10081.594579] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10081.594658] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10081.594793] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9ea3a89-dc86-43e0-b403-cf69fb98f50f already deleted. [10081.594836] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9ea3a89-dc86-43e0-b403-cf69fb98f50f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10082.035723] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f8cd488-a4c9-46fa-bc7e-72d6e03c581d [10082.036149] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10082.036404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10082.036486] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10082.036719] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10082.036814] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10082.036915] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f8cd488-a4c9-46fa-bc7e-72d6e03c581d already deleted. [10082.036997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f8cd488-a4c9-46fa-bc7e-72d6e03c581d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10082.834087] env[65939]: INFO networking_nsxv3.common.synchronization [None req-0092a5f0-59d3-4f20-a55c-02bb3ad0b604 None None] Enqueued Resource ID: 6e94d87f-45eb-4fd8-8ccc-1b7c2804f316 with Priority: HIGHEST for action port [10082.834204] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e94d87f-45eb-4fd8-8ccc-1b7c2804f316 with Priority: HIGHEST for action port [10082.834737] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e94d87f-45eb-4fd8-8ccc-1b7c2804f316 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10082.834737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e94d87f-45eb-4fd8-8ccc-1b7c2804f316" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10082.834859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e94d87f-45eb-4fd8-8ccc-1b7c2804f316" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10082.835310] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e94d87f-45eb-4fd8-8ccc-1b7c2804f316" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10082.835310] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e94d87f-45eb-4fd8-8ccc-1b7c2804f316',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10083.337627] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e94d87f-45eb-4fd8-8ccc-1b7c2804f316 [10083.337919] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10083.338067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10083.338136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10083.338349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10083.338436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10083.338534] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e94d87f-45eb-4fd8-8ccc-1b7c2804f316 already deleted. [10083.338624] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e94d87f-45eb-4fd8-8ccc-1b7c2804f316" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10085.004351] env[65939]: INFO networking_nsxv3.common.synchronization [None req-e09aad4a-5a79-4827-8532-aecf190c0b60 None None] Enqueued Resource ID: f7f85ea0-be14-48ab-8a13-8e626a1f088c with Priority: HIGHEST for action port [10085.005466] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f85ea0-be14-48ab-8a13-8e626a1f088c with Priority: HIGHEST for action port [10085.005594] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7f85ea0-be14-48ab-8a13-8e626a1f088c taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10085.005757] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7f85ea0-be14-48ab-8a13-8e626a1f088c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10085.005850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7f85ea0-be14-48ab-8a13-8e626a1f088c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10085.006635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7f85ea0-be14-48ab-8a13-8e626a1f088c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10085.006635] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7f85ea0-be14-48ab-8a13-8e626a1f088c',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10085.242202] env[65939]: INFO networking_nsxv3.common.synchronization [None req-64423842-4529-4a88-953b-121b748a1bd4 None None] Enqueued Resource ID: 7479fb4c-3184-4120-a9f5-181172f6c0c5 with Priority: HIGHEST for action port [10085.243953] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7479fb4c-3184-4120-a9f5-181172f6c0c5 with Priority: HIGHEST for action port [10085.245230] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-7479fb4c-3184-4120-a9f5-181172f6c0c5 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10085.245230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7479fb4c-3184-4120-a9f5-181172f6c0c5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10085.245230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7479fb4c-3184-4120-a9f5-181172f6c0c5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10085.245230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7479fb4c-3184-4120-a9f5-181172f6c0c5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10085.245230] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7479fb4c-3184-4120-a9f5-181172f6c0c5',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10085.511035] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7f85ea0-be14-48ab-8a13-8e626a1f088c [10085.511035] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10085.511035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10085.511035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10085.511035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10085.511035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10085.511035] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7f85ea0-be14-48ab-8a13-8e626a1f088c already deleted. [10085.511035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7f85ea0-be14-48ab-8a13-8e626a1f088c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10085.748808] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7479fb4c-3184-4120-a9f5-181172f6c0c5 [10085.748808] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10085.748808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10085.748808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10085.748808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10085.748808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10085.748808] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7479fb4c-3184-4120-a9f5-181172f6c0c5 already deleted. [10085.748808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7479fb4c-3184-4120-a9f5-181172f6c0c5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10087.455091] env[65939]: INFO networking_nsxv3.common.synchronization [None req-836f9663-5cc2-4f6b-a372-cf3f47bf9779 None None] Enqueued Resource ID: c09ba2b4-9363-426e-b8c1-aafead6ffd29 with Priority: HIGHEST for action port [10087.457646] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c09ba2b4-9363-426e-b8c1-aafead6ffd29 with Priority: HIGHEST for action port [10087.457646] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c09ba2b4-9363-426e-b8c1-aafead6ffd29 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10087.457646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c09ba2b4-9363-426e-b8c1-aafead6ffd29" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10087.457646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c09ba2b4-9363-426e-b8c1-aafead6ffd29" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10087.457646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c09ba2b4-9363-426e-b8c1-aafead6ffd29" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10087.457646] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c09ba2b4-9363-426e-b8c1-aafead6ffd29',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10087.621427] env[65939]: INFO networking_nsxv3.common.synchronization [None req-d6fdb9b1-5c9c-4f2b-82be-bff504278ae4 None None] Enqueued Resource ID: f91d225b-4310-4fc9-9154-ddc3081a111c with Priority: HIGHEST for action port [10087.624353] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f91d225b-4310-4fc9-9154-ddc3081a111c with Priority: HIGHEST for action port [10087.625038] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f91d225b-4310-4fc9-9154-ddc3081a111c taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10087.625491] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f91d225b-4310-4fc9-9154-ddc3081a111c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10087.625491] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f91d225b-4310-4fc9-9154-ddc3081a111c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10087.625849] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f91d225b-4310-4fc9-9154-ddc3081a111c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10087.625849] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91d225b-4310-4fc9-9154-ddc3081a111c',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10087.960899] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c09ba2b4-9363-426e-b8c1-aafead6ffd29 [10087.961139] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10087.961291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10087.961357] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10087.961639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10087.961732] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10087.961814] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c09ba2b4-9363-426e-b8c1-aafead6ffd29 already deleted. [10087.961887] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c09ba2b4-9363-426e-b8c1-aafead6ffd29" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10088.129412] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f91d225b-4310-4fc9-9154-ddc3081a111c [10088.130947] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10088.130947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10088.130947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10088.130947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10088.130947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10088.130947] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f91d225b-4310-4fc9-9154-ddc3081a111c already deleted. [10088.130947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f91d225b-4310-4fc9-9154-ddc3081a111c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10088.743443] env[65939]: INFO networking_nsxv3.common.synchronization [req-f0853666-b02b-47cc-a51a-ad2656de5663 req-c26c23da-4d15-4765-9986-469482b629a3 tempest-MigrationsAdminTest-1348166828 tempest-MigrationsAdminTest-1348166828-project-member] Enqueued Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGHEST for action security_group_members [10088.743443] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGHEST for action security_group_members [10088.743443] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10088.743443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10088.743443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10088.743443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10088.743443] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10088.743443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10088.743443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10088.743443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10088.743443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10088.743443] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10089.245790] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10089.245790] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10089.245790] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10089.246023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10089.246023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10089.246624] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10089.246624] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10089.246624] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10089.246624] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10089.246624] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10089.246624] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 already deleted. [10089.247305] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10089.257506] env[65939]: INFO networking_nsxv3.common.synchronization [None req-c4b2592b-24d3-45ea-be70-606de802733d None None] Enqueued Resource ID: 44b4d970-675c-4cf5-91fb-6aaae80898e3 with Priority: HIGHEST for action port [10089.258281] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b4d970-675c-4cf5-91fb-6aaae80898e3 with Priority: HIGHEST for action port [10089.258820] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-44b4d970-675c-4cf5-91fb-6aaae80898e3 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10089.258966] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44b4d970-675c-4cf5-91fb-6aaae80898e3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10089.259146] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44b4d970-675c-4cf5-91fb-6aaae80898e3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10089.259382] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44b4d970-675c-4cf5-91fb-6aaae80898e3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10089.259382] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44b4d970-675c-4cf5-91fb-6aaae80898e3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10089.762249] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44b4d970-675c-4cf5-91fb-6aaae80898e3 [10089.762249] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10089.762249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10089.762886] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10089.762886] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10089.762886] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10089.762886] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44b4d970-675c-4cf5-91fb-6aaae80898e3 already deleted. [10089.762886] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44b4d970-675c-4cf5-91fb-6aaae80898e3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10089.823635] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10089.823845] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10089.824016] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10089.824303] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10089.825082] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10089.825082] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10089.825082] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10089.827586] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10089.827766] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10089.828160] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10089.828291] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10089.828410] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10089.828516] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10089.828624] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10089.828724] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10089.828880] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Looking for TransportZone with name nsx-vlan-transportzone. [10089.862486] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10089.862637] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10089.866176] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10089.866479] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10089.866904] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock port-bac74a67-c2ab-4134-97e6-9b2bd1a99649 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10089.867085] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "port-bac74a67-c2ab-4134-97e6-9b2bd1a99649" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10089.867180] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "port-bac74a67-c2ab-4134-97e6-9b2bd1a99649" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10089.867494] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "port-bac74a67-c2ab-4134-97e6-9b2bd1a99649" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10089.867631] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bac74a67-c2ab-4134-97e6-9b2bd1a99649',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10090.374225] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10090.374448] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10090.374603] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10090.375068] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10090.375245] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10090.375428] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Segment Port bac74a67-c2ab-4134-97e6-9b2bd1a99649 not found, creating... [10090.375695] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10090.375855] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10090.375968] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10090.376216] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10090.376349] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10090.376889] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10090.377173] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10090.377268] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10090.377435] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10090.377569] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10090.378047] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Resource: SegmentPort with ID: bac74a67-c2ab-4134-97e6-9b2bd1a99649 is going to be created. [10090.408683] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10090.408893] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10090.412021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10090.412021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10090.412021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10090.412021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "port-bac74a67-c2ab-4134-97e6-9b2bd1a99649" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10090.723200] env[65939]: INFO networking_nsxv3.common.synchronization [req-b0330ecb-63b4-411e-922a-c73e66bbfb20 req-50973ae4-de81-43cd-9450-b6a02aae3017 tempest-ServersAdminNegativeTestJSON-58030456 tempest-ServersAdminNegativeTestJSON-58030456-project-member] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10090.723764] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10090.725339] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10090.725988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10090.726174] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10090.726512] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10090.726797] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10090.726956] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10090.727101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10090.727305] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10090.727543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10090.727691] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10091.145599] env[65939]: INFO networking_nsxv3.common.synchronization [req-f0853666-b02b-47cc-a51a-ad2656de5663 req-cc01539c-6c16-44b1-a01c-80ee813a7cb9 service nova] Enqueued Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGHEST for action security_group_rules [10091.146075] env[65939]: INFO networking_nsxv3.common.synchronization [req-f0853666-b02b-47cc-a51a-ad2656de5663 req-cc01539c-6c16-44b1-a01c-80ee813a7cb9 service nova] Enqueued Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGHEST for action security_group_members [10091.146075] env[65939]: INFO networking_nsxv3.common.synchronization [req-f0853666-b02b-47cc-a51a-ad2656de5663 req-cc01539c-6c16-44b1-a01c-80ee813a7cb9 service nova] Enqueued Resource ID: bac74a67-c2ab-4134-97e6-9b2bd1a99649 with Priority: HIGHEST for action port [10091.147197] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGHEST for action security_group_rules [10091.147197] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGHEST for action security_group_members [10091.147197] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac74a67-c2ab-4134-97e6-9b2bd1a99649 with Priority: HIGHEST for action port [10091.147422] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.147422] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.147515] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.147777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.147777] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10091.149302] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.149419] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.149483] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.149649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.149792] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.149886] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.150382] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.150443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.150512] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.150622] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10091.152980] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-bac74a67-c2ab-4134-97e6-9b2bd1a99649 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.152980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bac74a67-c2ab-4134-97e6-9b2bd1a99649" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.152980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bac74a67-c2ab-4134-97e6-9b2bd1a99649" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.152980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bac74a67-c2ab-4134-97e6-9b2bd1a99649" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.152980] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bac74a67-c2ab-4134-97e6-9b2bd1a99649',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10091.230401] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.230643] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.230716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.230934] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.231108] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.231399] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.231551] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.231597] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.231747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.231825] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.231914] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 already deleted. [10091.231995] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.245328] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.245508] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.245625] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.245867] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.246432] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.246432] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.246845] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.247219] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.247439] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.247683] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10091.247835] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10091.248723] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10091.248723] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10091.248723] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10091.248723] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10091.248723] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10091.267544] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10091.267722] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10091.267857] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10091.268059] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.268363] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.268533] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.268644] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.269153] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.269322] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeb6e135-96fb-4464-91f7-3d993cf3f9f6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10091.655250] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.655679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.672033] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bac74a67-c2ab-4134-97e6-9b2bd1a99649 with status ACTIVE [10091.672033] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.672033] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.672033] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.672033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.672033] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bac74a67-c2ab-4134-97e6-9b2bd1a99649 is going to be updated. [10091.673468] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10091.695702] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.695860] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.695928] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.696158] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.696291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.696456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bac74a67-c2ab-4134-97e6-9b2bd1a99649" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.772135] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.772593] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.772764] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.773122] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.773275] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.773449] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port eeb6e135-96fb-4464-91f7-3d993cf3f9f6 not found, creating... [10091.773917] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.774152] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.774275] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.774769] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.774921] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.775237] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.775746] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.775877] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.776175] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.776320] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.776651] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: eeb6e135-96fb-4464-91f7-3d993cf3f9f6 is going to be created. [10091.801668] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10091.802114] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10091.802301] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10091.802819] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10091.803145] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10091.803442] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10092.175809] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10092.648849] env[65939]: INFO networking_nsxv3.common.synchronization [req-b0330ecb-63b4-411e-922a-c73e66bbfb20 req-3eec3a92-ae42-462d-8ec8-bfb322a11422 service nova] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_rules [10092.649319] env[65939]: INFO networking_nsxv3.common.synchronization [req-b0330ecb-63b4-411e-922a-c73e66bbfb20 req-3eec3a92-ae42-462d-8ec8-bfb322a11422 service nova] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10092.649319] env[65939]: INFO networking_nsxv3.common.synchronization [req-b0330ecb-63b4-411e-922a-c73e66bbfb20 req-3eec3a92-ae42-462d-8ec8-bfb322a11422 service nova] Enqueued Resource ID: eeb6e135-96fb-4464-91f7-3d993cf3f9f6 with Priority: HIGHEST for action port [10092.649694] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_rules [10092.649817] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10092.650374] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb6e135-96fb-4464-91f7-3d993cf3f9f6 with Priority: HIGHEST for action port [10092.650540] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10092.650649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10092.650715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10092.650973] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10092.651061] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10092.652912] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10092.653028] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10092.653071] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10092.653270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10092.653933] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10092.653933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10092.653933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10092.653933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10092.653933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10092.653933] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10092.656546] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10092.657031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10092.657031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10092.657031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10092.657224] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeb6e135-96fb-4464-91f7-3d993cf3f9f6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10092.679936] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10092.679936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10092.679936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10092.679936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10092.679936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10092.680319] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 is going to be created. [10092.734921] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10092.734921] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10092.734921] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10092.734921] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10092.734921] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10092.744793] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: UNINITIALIZED for 2s [10092.885705] env[65939]: INFO networking_nsxv3.common.synchronization [None req-47df265e-9521-4471-9560-c9a47c62cc2d None None] Enqueued Resource ID: 8a859181-0221-43d3-b3c4-ffce69e918d5 with Priority: HIGHEST for action port [10092.886281] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a859181-0221-43d3-b3c4-ffce69e918d5 with Priority: HIGHEST for action port [10092.886576] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a859181-0221-43d3-b3c4-ffce69e918d5 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10092.886697] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a859181-0221-43d3-b3c4-ffce69e918d5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10092.886754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a859181-0221-43d3-b3c4-ffce69e918d5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10092.887047] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a859181-0221-43d3-b3c4-ffce69e918d5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10092.887134] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a859181-0221-43d3-b3c4-ffce69e918d5',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10093.158197] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10093.159198] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eeb6e135-96fb-4464-91f7-3d993cf3f9f6 with status ACTIVE [10093.159410] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.159543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.159602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.159799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.159889] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.160071] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.160178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.160266] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.160422] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.160500] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.160696] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.160784] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.160839] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.160978] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.164300] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.164427] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eeb6e135-96fb-4464-91f7-3d993cf3f9f6 is going to be updated. [10093.165619] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.165722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.187045] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.187045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.187045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.187374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.187374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.187374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeb6e135-96fb-4464-91f7-3d993cf3f9f6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.204503] env[65939]: INFO networking_nsxv3.common.synchronization [req-052105a4-69ec-4315-97de-70289866d85d req-16d3f326-12d1-4c22-954c-fa9713ec451a tempest-TenantUsagesTestJSON-548157220 tempest-TenantUsagesTestJSON-548157220-project-member] Enqueued Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGHEST for action security_group_members [10093.205309] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGHEST for action security_group_members [10093.205309] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-99711482-089a-4472-8ac3-fb1d995ba6dd taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.205309] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.205309] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.205645] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.205701] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.205753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.205810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.205951] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.206171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.206277] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10093.392144] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a859181-0221-43d3-b3c4-ffce69e918d5 [10093.392144] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.392144] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.392144] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.392144] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.392144] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.392144] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a859181-0221-43d3-b3c4-ffce69e918d5 already deleted. [10093.392144] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a859181-0221-43d3-b3c4-ffce69e918d5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.438477] env[65939]: INFO networking_nsxv3.common.synchronization [None req-43c28e84-1e3f-4748-a9ac-56d8c268bf08 tempest-VolumesAssistedSnapshotsTest-1278773564 tempest-VolumesAssistedSnapshotsTest-1278773564-project-member] Enqueued Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_rules [10093.439187] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_rules [10093.439477] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.439738] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.439738] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.439993] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.439993] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10093.667514] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10093.711715] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.711715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.711715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.711715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.711715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.711715] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.711715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.711715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.711715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.711715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.711715] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99711482-089a-4472-8ac3-fb1d995ba6dd already deleted. [10093.711715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.750153] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ebd7b205-2875-4ad0-8249-19eb88dcb2d3 tempest-VolumesAssistedSnapshotsTest-1278773564 tempest-VolumesAssistedSnapshotsTest-1278773564-project-member] Enqueued Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_rules [10093.750852] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_rules [10093.752233] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.752233] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.815249] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.815497] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.815673] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.815970] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.816271] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.816459] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.816599] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.816853] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.817014] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.817217] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10093.817323] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10093.817425] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10093.817528] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10093.817662] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10093.817773] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10093.818298] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10093.836682] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10093.837115] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10093.837115] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10093.837269] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.837492] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-667fc912-6ea4-4f64-972c-84e5b4567360 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.837667] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-667fc912-6ea4-4f64-972c-84e5b4567360" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.837775] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-667fc912-6ea4-4f64-972c-84e5b4567360" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.838139] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-667fc912-6ea4-4f64-972c-84e5b4567360" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.838278] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('667fc912-6ea4-4f64-972c-84e5b4567360',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10093.961116] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10093.961267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10093.961345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.961628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.961628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.961719] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 already deleted. [10093.961812] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10093.961926] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10093.962090] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10093.962166] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10094.169876] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10094.170092] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10094.170148] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10094.170352] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10094.170467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.170632] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be created. [10094.196974] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10094.197348] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10094.197348] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10094.197430] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10094.197656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.207638] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: UNINITIALIZED for 2s [10094.340969] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10094.341220] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10094.341342] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10094.341625] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10094.341774] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.341926] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 667fc912-6ea4-4f64-972c-84e5b4567360 not found, creating... [10094.342204] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10094.342761] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10094.342761] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10094.342761] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10094.342761] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.343052] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10094.343204] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10094.343318] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10094.343518] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10094.343849] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.343849] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 667fc912-6ea4-4f64-972c-84e5b4567360 is going to be created. [10094.364765] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10094.365024] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10094.365217] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10094.365544] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10094.365847] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.366029] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-667fc912-6ea4-4f64-972c-84e5b4567360" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.482847] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10094.482847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10094.482847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10094.482847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10094.482847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.482847] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 already deleted. [10094.482847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.753924] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: SUCCESS [10094.754219] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.754402] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10094.754618] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10094.754868] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10094.754995] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10094.754995] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10094.755275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10094.755333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.755410] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10094.755505] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10095.064148] env[65939]: INFO networking_nsxv3.common.synchronization [req-052105a4-69ec-4315-97de-70289866d85d req-077fd56e-5b8f-421c-a587-8f79581fbd0b service nova] Enqueued Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGHEST for action security_group_rules [10095.064338] env[65939]: INFO networking_nsxv3.common.synchronization [req-052105a4-69ec-4315-97de-70289866d85d req-077fd56e-5b8f-421c-a587-8f79581fbd0b service nova] Enqueued Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGHEST for action security_group_members [10095.064468] env[65939]: INFO networking_nsxv3.common.synchronization [req-052105a4-69ec-4315-97de-70289866d85d req-077fd56e-5b8f-421c-a587-8f79581fbd0b service nova] Enqueued Resource ID: 667fc912-6ea4-4f64-972c-84e5b4567360 with Priority: HIGHEST for action port [10095.065028] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGHEST for action security_group_rules [10095.065169] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGHEST for action security_group_members [10095.065265] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667fc912-6ea4-4f64-972c-84e5b4567360 with Priority: HIGHEST for action port [10095.065528] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99711482-089a-4472-8ac3-fb1d995ba6dd taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.065645] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.065711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.066036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.066573] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10095.070105] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-99711482-089a-4472-8ac3-fb1d995ba6dd taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.070105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.070105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.070105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.070105] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.070105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.070105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.070105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.070105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.070105] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10095.070638] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-667fc912-6ea4-4f64-972c-84e5b4567360 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.070638] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-667fc912-6ea4-4f64-972c-84e5b4567360" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.070729] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-667fc912-6ea4-4f64-972c-84e5b4567360" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.070967] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-667fc912-6ea4-4f64-972c-84e5b4567360" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.071011] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('667fc912-6ea4-4f64-972c-84e5b4567360',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10095.257788] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.257788] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.257788] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.258239] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.258278] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.258383] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.258448] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.258602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.258691] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.258789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.258923] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.259033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.259085] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.259383] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.259544] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.259686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.259739] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.259862] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.259931] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.260033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.260128] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10095.573561] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-99711482-089a-4472-8ac3-fb1d995ba6dd taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.573862] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.575634] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 667fc912-6ea4-4f64-972c-84e5b4567360 with status ACTIVE [10095.575925] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.576147] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.576244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.576522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.576605] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.576817] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.576978] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.577052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.577208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.577382] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.577553] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.577674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.577674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.577876] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.577950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.578347] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 667fc912-6ea4-4f64-972c-84e5b4567360 is going to be updated. [10095.579501] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10095.604400] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.604560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.604633] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.604865] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.605010] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.605176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-667fc912-6ea4-4f64-972c-84e5b4567360" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.762422] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95cc14d0-8b63-4ace-a5e1-f800e80faf90: rpc.has_security_group_logging(os_id): False [10095.823077] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.823077] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.823077] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.823801] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.824062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.824413] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.824741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.825050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.825584] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.825709] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.825952] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.826094] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.826158] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.826326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.826400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.826589] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.826679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.826744] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.826907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.826983] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.827105] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 is going to be created. [10095.916500] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10095.916690] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10095.916735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10095.916992] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10095.917192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10095.928994] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: IN_PROGRESS for 2s [10096.082383] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10096.218209] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: SUCCESS [10096.218423] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10096.218589] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10096.218803] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10096.219014] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10096.219136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10096.219195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10096.219347] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10096.219427] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10096.219509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10096.219599] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10096.585286] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10096.586692] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10096.587032] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10096.589633] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10096.589633] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10096.589633] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99711482-089a-4472-8ac3-fb1d995ba6dd is going to be created. [10096.620208] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10096.620208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10096.620208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10096.620208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10096.620208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10096.634208] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99711482-089a-4472-8ac3-fb1d995ba6dd in Status: UNINITIALIZED for 2s [10096.722217] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10096.722497] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10096.722585] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10096.723272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10096.723272] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10096.723272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10096.723272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10096.723528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10096.723563] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10096.723666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10096.723818] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10096.723913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10096.723978] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10096.724134] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10096.724270] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10096.724365] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10096.724429] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10096.724628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10096.724755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10096.724919] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10096.725021] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10097.038624] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b922f219-3b41-44ac-b7d3-f7fd6555a616 None None] Enqueued Resource ID: 6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b with Priority: HIGHEST for action port [10097.039430] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b with Priority: HIGHEST for action port [10097.039781] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10097.039980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10097.040081] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10097.041124] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10097.041257] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10097.227083] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32: rpc.has_security_group_logging(os_id): False [10097.250973] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10097.251223] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10097.251316] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10097.251608] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10097.251708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10097.251937] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10097.252041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10097.252158] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10097.252320] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10097.252390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10097.252581] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10097.252688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10097.252756] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10097.252925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10097.253051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10097.254827] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10097.254960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10097.255030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10097.255191] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10097.255283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10097.255371] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be created. [10097.285457] env[65939]: INFO networking_nsxv3.common.synchronization [None req-c32e9028-7c17-4e20-a6af-db3448d45e53 None None] Enqueued Resource ID: 9c2266fc-ed97-4c84-b1ac-6c93f9c57315 with Priority: HIGHEST for action port [10097.285681] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c2266fc-ed97-4c84-b1ac-6c93f9c57315 with Priority: HIGHEST for action port [10097.286397] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c2266fc-ed97-4c84-b1ac-6c93f9c57315 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10097.286649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c2266fc-ed97-4c84-b1ac-6c93f9c57315" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10097.286649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c2266fc-ed97-4c84-b1ac-6c93f9c57315" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10097.286931] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c2266fc-ed97-4c84-b1ac-6c93f9c57315" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10097.287367] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c2266fc-ed97-4c84-b1ac-6c93f9c57315',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10097.326240] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10097.326616] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10097.326949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10097.327594] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10097.327594] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10097.339667] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: IN_PROGRESS for 2s [10097.544948] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b [10097.545246] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10097.545396] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10097.545456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10097.545676] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10097.545752] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10097.546172] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b already deleted. [10097.546172] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6efac1fb-2a99-4a1a-a079-ee8fb9b65f4b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10097.789366] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c2266fc-ed97-4c84-b1ac-6c93f9c57315 [10097.790590] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10097.790590] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10097.790590] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10097.790590] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10097.790590] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10097.790590] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c2266fc-ed97-4c84-b1ac-6c93f9c57315 already deleted. [10097.790590] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c2266fc-ed97-4c84-b1ac-6c93f9c57315" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10097.945688] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: SUCCESS [10097.945688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10098.643675] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99711482-089a-4472-8ac3-fb1d995ba6dd in Status: SUCCESS [10098.643901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10098.644040] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10098.644261] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10098.644536] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10098.644646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10098.644646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10098.644748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10098.644826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10098.644979] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10098.645090] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10098.796736] env[65939]: INFO networking_nsxv3.common.synchronization [req-efc452ae-9ec8-4f10-9c73-577530a7e574 req-0d5cff5e-1b6b-4beb-9c24-e95bb0ddbdda tempest-DeleteServersAdminTestJSON-1620884639 tempest-DeleteServersAdminTestJSON-1620884639-project-member] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10098.797300] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10098.797596] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10098.797728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10098.797803] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10098.798075] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10098.798348] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10098.798348] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10098.798498] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10098.798531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10098.798609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10098.798720] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10099.147424] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-99711482-089a-4472-8ac3-fb1d995ba6dd taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.147584] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.147668] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.147874] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.148061] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.148172] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.148229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.148376] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.149476] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.149552] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.149722] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-99711482-089a-4472-8ac3-fb1d995ba6dd taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.149823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.149934] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.150200] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.150453] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.150453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.150606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.150640] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.151318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.151441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.151539] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10099.270364] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.270812] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.270812] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.270943] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.271682] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.271682] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.271682] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.271682] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.271947] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.271947] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10099.272137] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10099.273655] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10099.273804] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10099.273939] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10099.274031] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10099.275802] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10099.293763] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10099.294089] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10099.297095] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10099.297095] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.297095] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-565d29c4-bed8-4eac-91ba-5e3bd76a330b taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.297095] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-565d29c4-bed8-4eac-91ba-5e3bd76a330b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.297095] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-565d29c4-bed8-4eac-91ba-5e3bd76a330b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.297095] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-565d29c4-bed8-4eac-91ba-5e3bd76a330b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.297095] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('565d29c4-bed8-4eac-91ba-5e3bd76a330b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10099.300162] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.300340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.300408] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.300562] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.300608] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.300783] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.300887] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.300945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.301088] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.301160] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.301267] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 already deleted. [10099.301318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.353522] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: SUCCESS [10099.353522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.448984] env[65939]: INFO networking_nsxv3.common.synchronization [None req-fd31188e-e724-4302-8c7d-a042b29b56e3 None None] Enqueued Resource ID: 6e23ee65-5fca-4f9a-960a-cf55f91ad869 with Priority: HIGHEST for action port [10099.449384] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e23ee65-5fca-4f9a-960a-cf55f91ad869 with Priority: HIGHEST for action port [10099.449679] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e23ee65-5fca-4f9a-960a-cf55f91ad869 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.451310] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e23ee65-5fca-4f9a-960a-cf55f91ad869" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.451439] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e23ee65-5fca-4f9a-960a-cf55f91ad869" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.452045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e23ee65-5fca-4f9a-960a-cf55f91ad869" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.452090] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e23ee65-5fca-4f9a-960a-cf55f91ad869',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10099.654470] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99711482-089a-4472-8ac3-fb1d995ba6dd: rpc.has_security_group_logging(os_id): False [10099.678114] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.678351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.678445] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.678686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.678795] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.679048] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.679151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.679211] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.679376] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.679448] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.679624] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.679716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.679773] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.679957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.680034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.680283] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.680370] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.680406] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.680541] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.680658] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.680717] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99711482-089a-4472-8ac3-fb1d995ba6dd is going to be created. [10099.740695] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.740860] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.740938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.741193] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.741393] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.753970] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99711482-089a-4472-8ac3-fb1d995ba6dd in Status: IN_PROGRESS for 2s [10099.799586] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.800021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.800021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.800215] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.800700] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.800700] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 565d29c4-bed8-4eac-91ba-5e3bd76a330b not found, creating... [10099.800813] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.800880] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.800982] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.801201] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.801334] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.801590] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.801739] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.801846] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.802063] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.802228] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.802383] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 565d29c4-bed8-4eac-91ba-5e3bd76a330b is going to be created. [10099.825149] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.825252] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.825352] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.825617] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.825837] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.826070] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-565d29c4-bed8-4eac-91ba-5e3bd76a330b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.954708] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e23ee65-5fca-4f9a-960a-cf55f91ad869 [10099.955764] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10099.955764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10099.955764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10099.955764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10099.955764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10099.956666] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e23ee65-5fca-4f9a-960a-cf55f91ad869 already deleted. [10099.956666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e23ee65-5fca-4f9a-960a-cf55f91ad869" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10100.501187] env[65939]: INFO networking_nsxv3.common.synchronization [None req-bd242fd4-d791-4c51-aff3-88a460608602 None None] Enqueued Resource ID: ce61e1c3-5593-43b7-8447-784c3f67937c with Priority: HIGHEST for action port [10100.501187] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce61e1c3-5593-43b7-8447-784c3f67937c with Priority: HIGHEST for action port [10100.501434] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce61e1c3-5593-43b7-8447-784c3f67937c taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10100.504747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce61e1c3-5593-43b7-8447-784c3f67937c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10100.504747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce61e1c3-5593-43b7-8447-784c3f67937c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10100.504747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce61e1c3-5593-43b7-8447-784c3f67937c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10100.504747] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce61e1c3-5593-43b7-8447-784c3f67937c',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10100.762369] env[65939]: INFO networking_nsxv3.common.synchronization [req-efc452ae-9ec8-4f10-9c73-577530a7e574 req-a9d53264-cd38-46d1-a55e-3a62aa1f5a19 service nova] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_rules [10100.762566] env[65939]: INFO networking_nsxv3.common.synchronization [req-efc452ae-9ec8-4f10-9c73-577530a7e574 req-a9d53264-cd38-46d1-a55e-3a62aa1f5a19 service nova] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10100.762729] env[65939]: INFO networking_nsxv3.common.synchronization [req-efc452ae-9ec8-4f10-9c73-577530a7e574 req-a9d53264-cd38-46d1-a55e-3a62aa1f5a19 service nova] Enqueued Resource ID: 565d29c4-bed8-4eac-91ba-5e3bd76a330b with Priority: HIGHEST for action port [10100.763371] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_rules [10100.763512] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10100.763627] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 565d29c4-bed8-4eac-91ba-5e3bd76a330b with Priority: HIGHEST for action port [10100.763938] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10100.765053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10100.765053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10100.765357] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10100.765357] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10100.766850] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10100.766850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10100.766990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10100.767150] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10100.768268] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10100.768679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10100.768756] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10100.768964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10100.769088] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10100.769284] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10100.771872] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-565d29c4-bed8-4eac-91ba-5e3bd76a330b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10100.772022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-565d29c4-bed8-4eac-91ba-5e3bd76a330b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10100.772465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-565d29c4-bed8-4eac-91ba-5e3bd76a330b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10100.772465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-565d29c4-bed8-4eac-91ba-5e3bd76a330b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10100.772465] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('565d29c4-bed8-4eac-91ba-5e3bd76a330b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10101.007826] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce61e1c3-5593-43b7-8447-784c3f67937c [10101.008395] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.008395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.008395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.008600] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.008665] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.008735] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce61e1c3-5593-43b7-8447-784c3f67937c already deleted. [10101.008835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce61e1c3-5593-43b7-8447-784c3f67937c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.275223] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.275223] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.275223] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10101.277212] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 565d29c4-bed8-4eac-91ba-5e3bd76a330b with status ACTIVE [10101.277416] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.277573] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.277609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.277977] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.277977] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.278513] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.278513] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.278513] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.278687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.278687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.278799] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.280786] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.280786] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.280786] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.280786] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.280786] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 565d29c4-bed8-4eac-91ba-5e3bd76a330b is going to be updated. [10101.303417] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.303599] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.303599] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.304130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.304130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.304130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-565d29c4-bed8-4eac-91ba-5e3bd76a330b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.430739] env[65939]: INFO networking_nsxv3.common.synchronization [req-caf76dc5-2d67-450f-8bf4-3538edba30ca req-539bcbbb-fffa-4aaf-bdfb-334b1c62225e tempest-ServerDiagnosticsTest-1245518893 tempest-ServerDiagnosticsTest-1245518893-project-member] Enqueued Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGHEST for action security_group_members [10101.431964] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGHEST for action security_group_members [10101.432295] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.432441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.432509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.432816] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.432901] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.433014] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.433078] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.433222] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.433304] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.433397] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10101.767690] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99711482-089a-4472-8ac3-fb1d995ba6dd in Status: SUCCESS [10101.768047] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.775559] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ca96d855-e82a-4b79-bf19-5db4be0c2c5b None None] Enqueued Resource ID: 3b5e4e30-449f-4020-b8d9-3fd19be1c4e0 with Priority: HIGHEST for action port [10101.776210] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b5e4e30-449f-4020-b8d9-3fd19be1c4e0 with Priority: HIGHEST for action port [10101.776798] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b5e4e30-449f-4020-b8d9-3fd19be1c4e0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.776798] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b5e4e30-449f-4020-b8d9-3fd19be1c4e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.776798] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b5e4e30-449f-4020-b8d9-3fd19be1c4e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.777045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b5e4e30-449f-4020-b8d9-3fd19be1c4e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.777399] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b5e4e30-449f-4020-b8d9-3fd19be1c4e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10101.778374] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10101.936836] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.936836] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.936836] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.936836] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.936836] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.937203] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10101.937203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10101.937203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10101.938045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10101.938045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10101.938045] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 already deleted. [10101.938045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.281396] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b5e4e30-449f-4020-b8d9-3fd19be1c4e0 [10102.281647] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.281982] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.281982] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.282378] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.282378] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.282476] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b5e4e30-449f-4020-b8d9-3fd19be1c4e0 already deleted. [10102.282613] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b5e4e30-449f-4020-b8d9-3fd19be1c4e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.282970] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.283099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.283569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.283569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.283569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.283720] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be created. [10102.313705] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.313893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.313960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.314157] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.314314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.327292] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: UNINITIALIZED for 2s [10102.380963] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.381195] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.381411] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.381576] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.381972] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.381972] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.382249] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.382435] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.382435] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.383142] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10102.383142] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10102.383142] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10102.383142] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10102.383142] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10102.383323] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10102.383323] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10102.406255] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10102.408908] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10102.408908] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10102.408908] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.408908] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.408908] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.408908] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.408908] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.408908] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cab41d2c-bc27-41db-afd3-8cfd1c6799b8',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10102.684362] env[65939]: INFO networking_nsxv3.common.synchronization [None req-c241b090-285b-44c8-88fa-bc71479639c3 None None] Enqueued Resource ID: f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b with Priority: HIGHEST for action port [10102.685720] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b with Priority: HIGHEST for action port [10102.686121] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.686233] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.686288] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.687062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.687062] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10102.914067] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.914067] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.914067] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.914067] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.914067] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.914067] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port cab41d2c-bc27-41db-afd3-8cfd1c6799b8 not found, creating... [10102.914067] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.914067] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.914067] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.914067] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.914920] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.914920] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.914920] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.914920] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.915194] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.915284] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.915463] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: cab41d2c-bc27-41db-afd3-8cfd1c6799b8 is going to be created. [10102.941022] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10102.941314] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10102.941394] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10102.941685] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10102.941907] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10102.942148] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10103.098183] env[65939]: INFO networking_nsxv3.common.synchronization [None req-5f199e83-39ef-4277-8208-ea58d4cc5c07 None None] Enqueued Resource ID: f12758d0-2566-43d8-b142-a7011846ed01 with Priority: HIGHEST for action port [10103.098183] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12758d0-2566-43d8-b142-a7011846ed01 with Priority: HIGHEST for action port [10103.098183] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f12758d0-2566-43d8-b142-a7011846ed01 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10103.098626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f12758d0-2566-43d8-b142-a7011846ed01" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10103.098724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f12758d0-2566-43d8-b142-a7011846ed01" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10103.099135] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f12758d0-2566-43d8-b142-a7011846ed01" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10103.099387] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f12758d0-2566-43d8-b142-a7011846ed01',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10103.189134] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b [10103.189491] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10103.189620] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10103.189698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10103.189918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10103.190121] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10103.190190] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b already deleted. [10103.190306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6cc81cb-f08e-4f13-9bb5-7ab5fba4eb1b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10103.602716] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f12758d0-2566-43d8-b142-a7011846ed01 [10103.602716] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10103.602716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10103.602716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10103.602716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10103.602716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10103.602716] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f12758d0-2566-43d8-b142-a7011846ed01 already deleted. [10103.602716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f12758d0-2566-43d8-b142-a7011846ed01" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.078166] env[65939]: INFO networking_nsxv3.common.synchronization [req-caf76dc5-2d67-450f-8bf4-3538edba30ca req-5237dfdc-60db-48cd-a0c8-69300a8a6142 service nova] Enqueued Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGHEST for action security_group_rules [10104.078166] env[65939]: INFO networking_nsxv3.common.synchronization [req-caf76dc5-2d67-450f-8bf4-3538edba30ca req-5237dfdc-60db-48cd-a0c8-69300a8a6142 service nova] Enqueued Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGHEST for action security_group_members [10104.078166] env[65939]: INFO networking_nsxv3.common.synchronization [req-caf76dc5-2d67-450f-8bf4-3538edba30ca req-5237dfdc-60db-48cd-a0c8-69300a8a6142 service nova] Enqueued Resource ID: cab41d2c-bc27-41db-afd3-8cfd1c6799b8 with Priority: HIGHEST for action port [10104.078361] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGHEST for action security_group_rules [10104.078598] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGHEST for action security_group_members [10104.079008] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cab41d2c-bc27-41db-afd3-8cfd1c6799b8 with Priority: HIGHEST for action port [10104.079412] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.080765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.080765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.081136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.081136] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10104.082053] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.082914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.082914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.082914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.082914] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.082914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.082914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.082914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.082914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.083276] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10104.085828] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.085961] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.086041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.086209] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.086277] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cab41d2c-bc27-41db-afd3-8cfd1c6799b8',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10104.286405] env[65939]: INFO networking_nsxv3.common.synchronization [None req-1e0d934a-0051-4b74-a948-c69e251585a6 None None] Enqueued Resource ID: b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a with Priority: HIGHEST for action port [10104.288763] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a with Priority: HIGHEST for action port [10104.288763] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.288763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.288763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.289885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.291755] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10104.343392] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: SUCCESS [10104.343557] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.343724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.343936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.344222] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.345119] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.345215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.347328] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.347328] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.347328] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.347328] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10104.589622] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.589714] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.589953] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10104.590862] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cab41d2c-bc27-41db-afd3-8cfd1c6799b8 with status ACTIVE [10104.591048] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.591177] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.591696] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.591696] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.591696] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.591696] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.591897] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.591897] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.592765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.592765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.592765] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.592765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.592765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.592765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.592765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.592765] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cab41d2c-bc27-41db-afd3-8cfd1c6799b8 is going to be updated. [10104.620533] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.620533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.620533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.621327] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.621327] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.621327] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cab41d2c-bc27-41db-afd3-8cfd1c6799b8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.794434] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a [10104.794803] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.795711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.795711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.795711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.795711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.795943] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a already deleted. [10104.795943] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b94e1f7b-0fe8-46b2-b64e-e5bafd06be2a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.850208] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.850389] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.850522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.850800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.850886] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.851044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.851044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.851168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.851288] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.851388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.851544] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.851640] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.851702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.851831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.851966] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10104.852112] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10104.852112] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10104.852540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10104.852540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.852540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10104.852540] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10105.097401] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10105.273273] env[65939]: INFO networking_nsxv3.common.synchronization [None req-849dae17-8d9a-496f-aa8d-b98aa71cb270 None None] Enqueued Resource ID: bdc9fc11-7dc1-48f6-8530-cd51fe61cb91 with Priority: HIGHEST for action port [10105.273574] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc9fc11-7dc1-48f6-8530-cd51fe61cb91 with Priority: HIGHEST for action port [10105.274119] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdc9fc11-7dc1-48f6-8530-cd51fe61cb91 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.274363] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdc9fc11-7dc1-48f6-8530-cd51fe61cb91" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.274440] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdc9fc11-7dc1-48f6-8530-cd51fe61cb91" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.274710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdc9fc11-7dc1-48f6-8530-cd51fe61cb91" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.274834] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdc9fc11-7dc1-48f6-8530-cd51fe61cb91',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10105.311149] env[65939]: INFO networking_nsxv3.common.synchronization [None req-d5cffcfd-1d11-4b3f-b922-723402a8b121 None None] Enqueued Resource ID: 94637c00-cdbd-43c3-8f1a-ea7de456dfde with Priority: HIGHEST for action port [10105.312510] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94637c00-cdbd-43c3-8f1a-ea7de456dfde with Priority: HIGHEST for action port [10105.312866] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-94637c00-cdbd-43c3-8f1a-ea7de456dfde taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.313069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94637c00-cdbd-43c3-8f1a-ea7de456dfde" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.313183] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94637c00-cdbd-43c3-8f1a-ea7de456dfde" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.313460] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94637c00-cdbd-43c3-8f1a-ea7de456dfde" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.313546] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94637c00-cdbd-43c3-8f1a-ea7de456dfde',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10105.356661] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed701299-54b2-4fb1-b7d6-f2f2b3925210: rpc.has_security_group_logging(os_id): False [10105.378127] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.378318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.378318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.378487] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.378579] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.378830] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.379031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.379031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.379451] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.379451] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.379451] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.379451] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.379670] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.379670] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.379730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.379935] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.380072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.380294] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.380480] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.380558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.380647] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be created. [10105.475066] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.475370] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.475370] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.476573] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.476573] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.493139] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: IN_PROGRESS for 2s [10105.599623] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.599800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.599879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.600151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.600279] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.600417] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 is going to be created. [10105.637446] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.638179] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.638447] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.638809] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.639148] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.656053] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 in Status: UNINITIALIZED for 2s [10105.779041] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdc9fc11-7dc1-48f6-8530-cd51fe61cb91 [10105.779308] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.779550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.779698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.781297] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.781297] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.781297] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdc9fc11-7dc1-48f6-8530-cd51fe61cb91 already deleted. [10105.781297] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdc9fc11-7dc1-48f6-8530-cd51fe61cb91" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.817668] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94637c00-cdbd-43c3-8f1a-ea7de456dfde [10105.817668] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10105.817668] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10105.817668] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10105.817668] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10105.817924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10105.817924] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94637c00-cdbd-43c3-8f1a-ea7de456dfde already deleted. [10105.817924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94637c00-cdbd-43c3-8f1a-ea7de456dfde" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10107.505076] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: SUCCESS [10107.505366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10107.668029] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 in Status: SUCCESS [10107.668256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10107.668426] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10107.668648] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10107.668844] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10107.668963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10107.669156] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10107.669196] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10107.669464] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10107.669464] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10107.669464] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10108.172103] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10108.172277] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10108.172360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10108.172586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10108.172767] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10108.172873] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10108.172930] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10108.173092] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10108.173177] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10108.173268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10108.173412] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10108.173515] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10108.173600] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10108.173692] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10108.173821] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10108.173910] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10108.173964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10108.174114] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10108.174190] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10108.174272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10108.174357] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10108.677168] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6: rpc.has_security_group_logging(os_id): False [10108.700929] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10108.701136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10108.701197] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10108.701398] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10108.701495] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10108.701719] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10108.701818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10108.701894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10108.702047] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10108.702137] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10108.702454] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10108.702584] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10108.702677] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10108.702784] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10108.702851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10108.703238] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10108.703462] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10108.703525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10108.703670] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10108.703741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10108.703829] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 is going to be created. [10108.778069] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10108.778488] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10108.778630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10108.778900] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10108.779105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10108.795079] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 in Status: IN_PROGRESS for 2s [10109.401558] env[65939]: INFO networking_nsxv3.common.synchronization [req-29ebc72f-bd1d-4e95-9519-6da59040099a req-5484d3fe-e96b-483f-9ea7-054a42eb3420 tempest-VolumesAssistedSnapshotsTest-1278773564 tempest-VolumesAssistedSnapshotsTest-1278773564-project-member] Enqueued Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_members [10109.402672] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_members [10109.403305] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10109.403305] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10109.403305] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10109.403534] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10109.403627] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10109.404196] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10109.404196] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10109.404196] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10109.404196] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10109.404196] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10109.908509] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10109.908509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10109.908509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10109.908509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10109.908509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10109.908943] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10109.908943] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10109.908943] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10109.908943] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10109.909188] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10109.909188] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 already deleted. [10109.909188] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10109.941178] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-607 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10109.941394] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-607" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10109.941815] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-607" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10109.945024] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-607" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10109.945024] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10109.945024] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10109.945024] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10109.945024] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10109.945024] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10109.945024] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10109.945024] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10109.945024] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10109.945024] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10109.945024] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10109.945024] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10109.945024] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10110.009370] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10110.009534] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.065 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10110.009667] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10110.009838] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-607" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10110.010190] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-bcd080fc-51d1-43eb-b6a5-84caec20e593 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10110.010366] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-bcd080fc-51d1-43eb-b6a5-84caec20e593" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10110.010484] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-bcd080fc-51d1-43eb-b6a5-84caec20e593" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10110.010884] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-bcd080fc-51d1-43eb-b6a5-84caec20e593" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10110.011055] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd080fc-51d1-43eb-b6a5-84caec20e593',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10110.513313] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10110.513705] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10110.513705] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10110.513969] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10110.514131] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10110.514290] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port bcd080fc-51d1-43eb-b6a5-84caec20e593 not found, creating... [10110.514548] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10110.514701] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10110.514811] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10110.515355] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10110.515547] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10110.515842] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10110.516007] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10110.516131] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10110.516399] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10110.516534] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10110.516672] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: bcd080fc-51d1-43eb-b6a5-84caec20e593 is going to be created. [10110.537476] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10110.537837] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10110.537837] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10110.538185] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10110.539087] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10110.539087] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-bcd080fc-51d1-43eb-b6a5-84caec20e593" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10110.814963] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 in Status: SUCCESS [10110.814963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.257446] env[65939]: INFO networking_nsxv3.common.synchronization [req-29ebc72f-bd1d-4e95-9519-6da59040099a req-a946a434-c7ad-4720-b795-c39031ffad10 service nova] Enqueued Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_rules [10111.257446] env[65939]: INFO networking_nsxv3.common.synchronization [req-29ebc72f-bd1d-4e95-9519-6da59040099a req-a946a434-c7ad-4720-b795-c39031ffad10 service nova] Enqueued Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_members [10111.257446] env[65939]: INFO networking_nsxv3.common.synchronization [req-29ebc72f-bd1d-4e95-9519-6da59040099a req-a946a434-c7ad-4720-b795-c39031ffad10 service nova] Enqueued Resource ID: bcd080fc-51d1-43eb-b6a5-84caec20e593 with Priority: HIGHEST for action port [10111.258065] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_rules [10111.258065] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_members [10111.258065] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd080fc-51d1-43eb-b6a5-84caec20e593 with Priority: HIGHEST for action port [10111.258803] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.258803] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.258803] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.259151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.259151] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10111.261856] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.262058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.262166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.262385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.262588] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.262692] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.262763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.262949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.263051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.263164] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10111.264766] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcd080fc-51d1-43eb-b6a5-84caec20e593 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.264938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcd080fc-51d1-43eb-b6a5-84caec20e593" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.265116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcd080fc-51d1-43eb-b6a5-84caec20e593" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.265334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcd080fc-51d1-43eb-b6a5-84caec20e593" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.265694] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd080fc-51d1-43eb-b6a5-84caec20e593',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10111.397544] env[65939]: INFO networking_nsxv3.common.synchronization [None req-f0eeeb5d-9f36-4081-b2d8-7d94c53d2aa3 None None] Enqueued Resource ID: 58f83ebc-a7bf-4bb2-8c8f-1c3991194835 with Priority: HIGHEST for action port [10111.397544] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58f83ebc-a7bf-4bb2-8c8f-1c3991194835 with Priority: HIGHEST for action port [10111.397544] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-58f83ebc-a7bf-4bb2-8c8f-1c3991194835 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.397544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58f83ebc-a7bf-4bb2-8c8f-1c3991194835" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.397544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58f83ebc-a7bf-4bb2-8c8f-1c3991194835" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.397544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58f83ebc-a7bf-4bb2-8c8f-1c3991194835" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.397544] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58f83ebc-a7bf-4bb2-8c8f-1c3991194835',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10111.767423] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.767598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.768313] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10111.769641] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcd080fc-51d1-43eb-b6a5-84caec20e593 with status ACTIVE [10111.772990] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.772990] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.772990] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.772990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.772990] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcd080fc-51d1-43eb-b6a5-84caec20e593 is going to be updated. [10111.793884] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.793884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.793884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.793884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.793884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.793884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcd080fc-51d1-43eb-b6a5-84caec20e593" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.901162] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58f83ebc-a7bf-4bb2-8c8f-1c3991194835 [10111.901313] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.901448] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.901515] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.901737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.901827] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.901933] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58f83ebc-a7bf-4bb2-8c8f-1c3991194835 already deleted. [10111.902016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58f83ebc-a7bf-4bb2-8c8f-1c3991194835" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.910110] env[65939]: INFO networking_nsxv3.common.synchronization [req-d5f03c69-d8a8-4d2c-8299-9808a15222ad req-c645d27c-f2aa-4fc7-82a5-6b88825ea176 tempest-ServerDiskConfigTestJSON-1925570613 tempest-ServerDiskConfigTestJSON-1925570613-project-member] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10111.910840] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10111.911903] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.912086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.912156] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.912442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.912603] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10111.912737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10111.912780] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10111.912906] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10111.912986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10111.913233] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10112.271385] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10112.290950] env[65939]: INFO networking_nsxv3.common.synchronization [None req-767d4f09-3c7f-4899-ab6e-99f33a0ebdd4 tempest-ServersWithSpecificFlavorTestJSON-1136329551 tempest-ServersWithSpecificFlavorTestJSON-1136329551-project-member] Enqueued Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_rules [10112.291518] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_rules [10112.292188] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.292413] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.292510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.293124] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.293320] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10112.352193] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.352392] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-617" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.352516] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-617" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.352836] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-617" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.353132] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.353292] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.353406] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.353629] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.353772] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.353991] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10112.354089] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10112.354196] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10112.354299] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10112.354402] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10112.354502] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10112.354629] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10112.372993] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10112.373801] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10112.373801] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10112.373801] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-617" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.373801] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-ca31e24c-3718-431f-ab3f-f51acf1769bb taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.374072] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-ca31e24c-3718-431f-ab3f-f51acf1769bb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.374072] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-ca31e24c-3718-431f-ab3f-f51acf1769bb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.374383] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-ca31e24c-3718-431f-ab3f-f51acf1769bb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.374517] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca31e24c-3718-431f-ab3f-f51acf1769bb',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10112.416443] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.416638] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.416638] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.416795] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.416884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.417208] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.417309] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.417360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.417538] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.417616] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.417717] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 already deleted. [10112.417802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.775023] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.775023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.775023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.775023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.775023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.775023] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 is going to be created. [10112.800560] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.800791] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.800962] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.801298] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.801500] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.814415] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 in Status: UNINITIALIZED for 2s [10112.827043] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.827232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.827436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.827673] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.827766] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.827864] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 already deleted. [10112.827949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.862754] env[65939]: INFO networking_nsxv3.common.synchronization [None req-eb559007-dc78-4557-96c7-d98de53b2cfa tempest-ServersWithSpecificFlavorTestJSON-1136329551 tempest-ServersWithSpecificFlavorTestJSON-1136329551-project-member] Enqueued Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_rules [10112.863473] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_rules [10112.863865] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.864064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.864218] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.864494] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.864636] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10112.877550] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.877793] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.877918] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.878348] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.878462] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.878595] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port ca31e24c-3718-431f-ab3f-f51acf1769bb not found, creating... [10112.878848] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.879013] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.879136] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.879364] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.879491] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.879773] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.879930] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.880344] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.880614] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.880733] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.880875] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: ca31e24c-3718-431f-ab3f-f51acf1769bb is going to be created. [10112.908266] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10112.908585] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10112.908585] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10112.910196] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10112.910196] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10112.910196] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-ca31e24c-3718-431f-ab3f-f51acf1769bb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10113.281763] env[65939]: INFO networking_nsxv3.common.synchronization [None req-acaa99bb-43ad-4af0-a801-2db4e012d5e4 None None] Enqueued Resource ID: 440d332c-337e-41b9-9a57-8b2ec924a967 with Priority: HIGHEST for action port [10113.281763] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440d332c-337e-41b9-9a57-8b2ec924a967 with Priority: HIGHEST for action port [10113.281763] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-440d332c-337e-41b9-9a57-8b2ec924a967 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10113.281763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-440d332c-337e-41b9-9a57-8b2ec924a967" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10113.281763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-440d332c-337e-41b9-9a57-8b2ec924a967" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10113.281763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-440d332c-337e-41b9-9a57-8b2ec924a967" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10113.281763] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('440d332c-337e-41b9-9a57-8b2ec924a967',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10113.389910] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10113.390194] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10113.390194] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10113.390393] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10113.390449] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10113.390546] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 already deleted. [10113.390738] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10113.675459] env[65939]: INFO networking_nsxv3.common.synchronization [req-d5f03c69-d8a8-4d2c-8299-9808a15222ad req-97a464ae-4b69-4ab9-b9cc-e976f7dd07af service nova] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_rules [10113.675723] env[65939]: INFO networking_nsxv3.common.synchronization [req-d5f03c69-d8a8-4d2c-8299-9808a15222ad req-97a464ae-4b69-4ab9-b9cc-e976f7dd07af service nova] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10113.675937] env[65939]: INFO networking_nsxv3.common.synchronization [req-d5f03c69-d8a8-4d2c-8299-9808a15222ad req-97a464ae-4b69-4ab9-b9cc-e976f7dd07af service nova] Enqueued Resource ID: ca31e24c-3718-431f-ab3f-f51acf1769bb with Priority: HIGHEST for action port [10113.677540] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_rules [10113.677687] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10113.677785] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca31e24c-3718-431f-ab3f-f51acf1769bb with Priority: HIGHEST for action port [10113.678118] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10113.678270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10113.678743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10113.678743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10113.679111] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10113.680065] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10113.680222] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10113.680300] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10113.680502] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10113.680653] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10113.680844] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10113.680912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10113.681100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10113.681215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10113.681410] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10113.682556] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca31e24c-3718-431f-ab3f-f51acf1769bb taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10113.682648] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca31e24c-3718-431f-ab3f-f51acf1769bb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10113.682735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca31e24c-3718-431f-ab3f-f51acf1769bb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10113.682917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca31e24c-3718-431f-ab3f-f51acf1769bb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10113.682993] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca31e24c-3718-431f-ab3f-f51acf1769bb',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10113.785422] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 440d332c-337e-41b9-9a57-8b2ec924a967 [10113.785690] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10113.785833] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10113.785894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10113.786155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10113.786232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10113.787102] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:440d332c-337e-41b9-9a57-8b2ec924a967 already deleted. [10113.787102] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-440d332c-337e-41b9-9a57-8b2ec924a967" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.187616] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.187616] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.187616] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10114.188409] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca31e24c-3718-431f-ab3f-f51acf1769bb with status ACTIVE [10114.190277] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.190277] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.190277] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.190277] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.190277] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.190277] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.190664] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.190664] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.191021] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.191021] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.191337] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.191423] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.191423] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.192057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.192204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.192305] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca31e24c-3718-431f-ab3f-f51acf1769bb is going to be updated. [10114.218312] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.218457] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.218529] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.218742] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.218873] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.219045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca31e24c-3718-431f-ab3f-f51acf1769bb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.415944] env[65939]: INFO networking_nsxv3.common.synchronization [req-e246da0c-6b82-4450-8a99-7575fc235d65 req-620d9754-4e2a-4ad9-af9a-5bc4ffb20056 tempest-ServerAddressesNegativeTestJSON-1001871260 tempest-ServerAddressesNegativeTestJSON-1001871260-project-member] Enqueued Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGHEST for action security_group_members [10114.417490] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGHEST for action security_group_members [10114.417828] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-b696069c-81a6-4243-95fa-f24b214bded3 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.417957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.418039] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.418306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.418463] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.418562] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.418624] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.418768] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.418850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.418951] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10114.695749] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10114.825440] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 in Status: SUCCESS [10114.826774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.826774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.826774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.826774] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.827176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.827338] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.827557] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.827700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.827803] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.827930] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10114.921708] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.921868] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.921955] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.922290] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.922433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.922631] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10114.922730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10114.922791] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10114.922950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10114.923038] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10114.923126] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b696069c-81a6-4243-95fa-f24b214bded3 already deleted. [10114.923224] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10115.201415] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10115.201415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10115.201415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10115.201692] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10115.201692] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10115.201692] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be created. [10115.230517] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10115.230810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10115.230810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10115.231107] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10115.231361] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10115.249015] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: UNINITIALIZED for 2s [10115.330660] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10115.521521] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10115.521881] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "network-108" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10115.521881] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "network-108" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10115.522426] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "network-108" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10115.522514] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10115.522636] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10115.522953] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10115.523061] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10115.523539] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10115.523640] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10115.523787] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10115.523883] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10115.524041] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10115.524179] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10115.524253] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10115.524383] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Looking for TransportZone with name nsx-vlan-transportzone. [10115.549318] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10115.549318] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10115.549601] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10115.550383] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "network-108" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10115.550383] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock port-62151903-b435-4249-9ffc-ccfbab520e5b taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10115.550635] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "port-62151903-b435-4249-9ffc-ccfbab520e5b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10115.550841] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "port-62151903-b435-4249-9ffc-ccfbab520e5b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10115.552550] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "port-62151903-b435-4249-9ffc-ccfbab520e5b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10115.552550] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62151903-b435-4249-9ffc-ccfbab520e5b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10115.833941] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62f0f078-b1aa-4721-8b07-eb126a6fb449: rpc.has_security_group_logging(os_id): False [10115.856460] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10115.856693] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10115.856693] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10115.856927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10115.857072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10115.857446] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10115.857579] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10115.857626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10115.857785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10115.857866] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10115.857955] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 is going to be created. [10115.878182] env[65939]: INFO networking_nsxv3.common.synchronization [None req-6e297d04-9364-4e92-8b15-ff6c19fb757d None None] Enqueued Resource ID: eeddf01f-078e-4d2c-a499-b759d609d6da with Priority: HIGHEST for action port [10115.878986] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeddf01f-078e-4d2c-a499-b759d609d6da with Priority: HIGHEST for action port [10115.879858] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-eeddf01f-078e-4d2c-a499-b759d609d6da taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10115.880075] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eeddf01f-078e-4d2c-a499-b759d609d6da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10115.880289] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eeddf01f-078e-4d2c-a499-b759d609d6da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10115.880589] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eeddf01f-078e-4d2c-a499-b759d609d6da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10115.880720] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eeddf01f-078e-4d2c-a499-b759d609d6da',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10115.961321] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10115.961486] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10115.961586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10115.961896] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10115.961990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10115.975995] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 in Status: IN_PROGRESS for 2s [10116.055616] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10116.055901] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10116.056044] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10116.056343] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10116.056520] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10116.056684] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Segment Port 62151903-b435-4249-9ffc-ccfbab520e5b not found, creating... [10116.057009] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10116.057253] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10116.057376] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10116.057701] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10116.057800] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10116.058571] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10116.058690] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10116.058878] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10116.059158] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10116.059361] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10116.059582] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Resource: SegmentPort with ID: 62151903-b435-4249-9ffc-ccfbab520e5b is going to be created. [10116.084249] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10116.084550] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10116.084636] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10116.084923] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10116.085206] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10116.085447] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "port-62151903-b435-4249-9ffc-ccfbab520e5b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10116.383982] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eeddf01f-078e-4d2c-a499-b759d609d6da [10116.384305] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10116.384470] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10116.384545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10116.384756] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10116.384844] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10116.384938] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eeddf01f-078e-4d2c-a499-b759d609d6da already deleted. [10116.385090] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eeddf01f-078e-4d2c-a499-b759d609d6da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10116.817496] env[65939]: INFO networking_nsxv3.common.synchronization [req-e246da0c-6b82-4450-8a99-7575fc235d65 req-99ac5a8b-13b0-4024-b9ec-a1cc8d35de71 service nova] Enqueued Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGHEST for action security_group_rules [10116.819489] env[65939]: INFO networking_nsxv3.common.synchronization [req-e246da0c-6b82-4450-8a99-7575fc235d65 req-99ac5a8b-13b0-4024-b9ec-a1cc8d35de71 service nova] Enqueued Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGHEST for action security_group_members [10116.819489] env[65939]: INFO networking_nsxv3.common.synchronization [req-e246da0c-6b82-4450-8a99-7575fc235d65 req-99ac5a8b-13b0-4024-b9ec-a1cc8d35de71 service nova] Enqueued Resource ID: 62151903-b435-4249-9ffc-ccfbab520e5b with Priority: HIGHEST for action port [10116.819489] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGHEST for action security_group_rules [10116.819489] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGHEST for action security_group_members [10116.819489] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62151903-b435-4249-9ffc-ccfbab520e5b with Priority: HIGHEST for action port [10116.819489] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b696069c-81a6-4243-95fa-f24b214bded3 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10116.819489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10116.819489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10116.819489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10116.819489] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10116.821012] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-b696069c-81a6-4243-95fa-f24b214bded3 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10116.821594] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10116.823654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10116.823654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10116.823654] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10116.823654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10116.823654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10116.823654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10116.823654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10116.823654] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10116.824124] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-62151903-b435-4249-9ffc-ccfbab520e5b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10116.824205] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62151903-b435-4249-9ffc-ccfbab520e5b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10116.824486] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62151903-b435-4249-9ffc-ccfbab520e5b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10116.824700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62151903-b435-4249-9ffc-ccfbab520e5b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10116.824949] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62151903-b435-4249-9ffc-ccfbab520e5b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10117.259398] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: SUCCESS [10117.259769] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.260043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.260043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.260312] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.260389] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.260426] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.260619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.260712] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.260801] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.260892] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10117.326899] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-b696069c-81a6-4243-95fa-f24b214bded3 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.327048] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.327302] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10117.328504] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62151903-b435-4249-9ffc-ccfbab520e5b with status ACTIVE [10117.328504] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.328504] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.329017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.329017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.329017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.329123] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.329462] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.329462] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.329567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.329567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.329746] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.329835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.329903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.330057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.330145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.330282] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62151903-b435-4249-9ffc-ccfbab520e5b is going to be updated. [10117.355895] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.355895] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.356037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.356760] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.356760] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.356760] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62151903-b435-4249-9ffc-ccfbab520e5b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.696588] env[65939]: INFO networking_nsxv3.common.synchronization [None req-27dbd914-bfe1-4aa6-a360-4593428e8a4a None None] Enqueued Resource ID: 27c2bd40-6d96-46bf-a6b7-2a26e4207d90 with Priority: HIGHEST for action port [10117.697580] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27c2bd40-6d96-46bf-a6b7-2a26e4207d90 with Priority: HIGHEST for action port [10117.697807] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-27c2bd40-6d96-46bf-a6b7-2a26e4207d90 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.697962] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27c2bd40-6d96-46bf-a6b7-2a26e4207d90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.698036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27c2bd40-6d96-46bf-a6b7-2a26e4207d90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.699644] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27c2bd40-6d96-46bf-a6b7-2a26e4207d90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.699644] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27c2bd40-6d96-46bf-a6b7-2a26e4207d90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10117.764683] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.764909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.764909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.765373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.765563] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.765706] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.765762] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.765900] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.765986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.766094] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.766247] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.766385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.766385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.766532] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.766658] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.766777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.766826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.767023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.767146] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.767239] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.767330] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10117.832795] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10117.920129] env[65939]: INFO networking_nsxv3.common.synchronization [req-6da90cba-2963-4d85-a457-993459921dca req-99a7c10f-8928-438a-b573-674576f5b50b tempest-ServersNegativeTestMultiTenantJSON-1466868589 tempest-ServersNegativeTestMultiTenantJSON-1466868589-project-member] Enqueued Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGHEST for action security_group_members [10117.922414] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGHEST for action security_group_members [10117.923036] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1c2520-27f7-4185-a08f-749f3520871d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.923156] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.923219] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.923449] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.923681] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10117.923787] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10117.923787] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10117.923917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10117.923978] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10117.924118] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10117.990666] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 in Status: SUCCESS [10117.990885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.202017] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27c2bd40-6d96-46bf-a6b7-2a26e4207d90 [10118.202017] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.202017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.202017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.202017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.202321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.202321] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27c2bd40-6d96-46bf-a6b7-2a26e4207d90 already deleted. [10118.202321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27c2bd40-6d96-46bf-a6b7-2a26e4207d90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.273007] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bc9971a-4944-4376-bed1-dab9f3b05345: rpc.has_security_group_logging(os_id): False [10118.293574] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.293707] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.293861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.293985] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.294140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.294281] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.294379] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.294609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.294609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.294707] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.295381] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.295381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.295381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.295381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.295381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.295381] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.297368] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.297368] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.297368] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.297368] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.297368] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be created. [10118.339399] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.339399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.339399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.339399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.339399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.339399] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b696069c-81a6-4243-95fa-f24b214bded3 is going to be created. [10118.364067] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.364401] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.364554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.364863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.365521] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.368952] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.368952] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.368952] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.368952] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.368952] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.380202] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b696069c-81a6-4243-95fa-f24b214bded3 in Status: UNINITIALIZED for 2s [10118.380939] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: IN_PROGRESS for 2s [10118.426474] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.426635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.426747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.426932] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.427164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.427337] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.427566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.427566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.427666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.427722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.427810] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa1c2520-27f7-4185-a08f-749f3520871d already deleted. [10118.427887] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.805676] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.805876] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "network-308" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.805997] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "network-308" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.806574] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "network-308" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.806671] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.806745] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.806843] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.807487] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.807487] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.807487] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10118.807726] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10118.807726] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10118.807726] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10118.807856] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10118.807924] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10118.808205] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Looking for TransportZone with name nsx-vlan-transportzone. [10118.829888] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10118.830057] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10118.830500] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10118.830696] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "network-308" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10118.831014] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock port-68a30628-081e-4033-b0b5-9d2fb682e828 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.831190] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "port-68a30628-081e-4033-b0b5-9d2fb682e828" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.831308] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "port-68a30628-081e-4033-b0b5-9d2fb682e828" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.831611] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "port-68a30628-081e-4033-b0b5-9d2fb682e828" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.831745] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68a30628-081e-4033-b0b5-9d2fb682e828',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10118.890427] env[65939]: INFO networking_nsxv3.common.synchronization [None req-552640d1-4995-40b4-9c6d-c6e0e168e235 None None] Enqueued Resource ID: bbcfc826-e1b3-40b1-bebb-01746669be8d with Priority: HIGHEST for action port [10118.890927] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbcfc826-e1b3-40b1-bebb-01746669be8d with Priority: HIGHEST for action port [10118.891245] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbcfc826-e1b3-40b1-bebb-01746669be8d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10118.891369] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbcfc826-e1b3-40b1-bebb-01746669be8d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10118.891437] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbcfc826-e1b3-40b1-bebb-01746669be8d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10118.891716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbcfc826-e1b3-40b1-bebb-01746669be8d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10118.891802] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbcfc826-e1b3-40b1-bebb-01746669be8d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10119.333962] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10119.334201] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10119.334328] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10119.334610] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10119.334785] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10119.334945] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Segment Port 68a30628-081e-4033-b0b5-9d2fb682e828 not found, creating... [10119.336646] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10119.336646] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10119.336646] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10119.336646] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10119.336646] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10119.336646] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10119.336646] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10119.336646] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10119.336646] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10119.337114] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10119.337114] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Resource: SegmentPort with ID: 68a30628-081e-4033-b0b5-9d2fb682e828 is going to be created. [10119.364193] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10119.364540] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10119.365225] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10119.365225] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10119.365225] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10119.365498] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "port-68a30628-081e-4033-b0b5-9d2fb682e828" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10119.393759] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbcfc826-e1b3-40b1-bebb-01746669be8d [10119.394160] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10119.394366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10119.394454] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10119.394714] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10119.394865] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10119.395054] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbcfc826-e1b3-40b1-bebb-01746669be8d already deleted. [10119.395210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbcfc826-e1b3-40b1-bebb-01746669be8d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.065777] env[65939]: INFO networking_nsxv3.common.synchronization [None req-0dda86e8-4789-4e67-b808-05b3fc3364a4 tempest-ServerActionsV293TestJSON-1024262967 tempest-ServerActionsV293TestJSON-1024262967-project-member] Enqueued Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_rules [10120.066116] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_rules [10120.066417] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0448a07-8b92-443f-84c4-39c4126ca3d2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.066541] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.066605] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.067389] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.067389] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10120.073224] env[65939]: INFO networking_nsxv3.common.synchronization [req-6da90cba-2963-4d85-a457-993459921dca req-69b7086c-12bd-4a2d-9865-e3abb6263566 service nova] Enqueued Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGHEST for action security_group_rules [10120.074075] env[65939]: INFO networking_nsxv3.common.synchronization [req-6da90cba-2963-4d85-a457-993459921dca req-69b7086c-12bd-4a2d-9865-e3abb6263566 service nova] Enqueued Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGHEST for action security_group_members [10120.074075] env[65939]: INFO networking_nsxv3.common.synchronization [req-6da90cba-2963-4d85-a457-993459921dca req-69b7086c-12bd-4a2d-9865-e3abb6263566 service nova] Enqueued Resource ID: 68a30628-081e-4033-b0b5-9d2fb682e828 with Priority: HIGHEST for action port [10120.074075] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGHEST for action security_group_rules [10120.074324] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGHEST for action security_group_members [10120.074324] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68a30628-081e-4033-b0b5-9d2fb682e828 with Priority: HIGHEST for action port [10120.074972] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa1c2520-27f7-4185-a08f-749f3520871d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.075235] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.075314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.075502] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.075583] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10120.076818] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1c2520-27f7-4185-a08f-749f3520871d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.077016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.077016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.077347] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.077480] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.077582] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.077690] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.077794] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.077879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.077971] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10120.079530] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-68a30628-081e-4033-b0b5-9d2fb682e828 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.079636] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68a30628-081e-4033-b0b5-9d2fb682e828" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.081060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68a30628-081e-4033-b0b5-9d2fb682e828" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.081060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68a30628-081e-4033-b0b5-9d2fb682e828" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.081060] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68a30628-081e-4033-b0b5-9d2fb682e828',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10120.380810] env[65939]: INFO networking_nsxv3.common.synchronization [None req-22fe2c5e-5f89-4174-8eb0-669acb627738 tempest-ServerActionsV293TestJSON-1024262967 tempest-ServerActionsV293TestJSON-1024262967-project-member] Enqueued Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_rules [10120.383496] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_rules [10120.387596] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0448a07-8b92-443f-84c4-39c4126ca3d2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.387744] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.397398] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b696069c-81a6-4243-95fa-f24b214bded3 in Status: SUCCESS [10120.397894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.397894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.398168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.398423] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.398581] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.398665] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.398863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.399047] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.399123] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.399264] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10120.404166] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: SUCCESS [10120.404394] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.582212] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10120.584262] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1c2520-27f7-4185-a08f-749f3520871d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.584262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.584262] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68a30628-081e-4033-b0b5-9d2fb682e828 with status ACTIVE [10120.584262] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.584262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.584262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.584592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.584628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.584908] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.585097] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.585211] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.585475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.586700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.586700] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.586700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.586700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.586700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.586700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.586700] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68a30628-081e-4033-b0b5-9d2fb682e828 is going to be updated. [10120.595882] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.596566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.596566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.596566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.596761] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.596809] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 already deleted. [10120.597415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.597727] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.598350] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.598350] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10120.613279] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.614251] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.614857] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.615175] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.615779] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.616737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68a30628-081e-4033-b0b5-9d2fb682e828" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.640434] env[65939]: INFO networking_nsxv3.common.synchronization [None req-09fcb045-7f17-4adf-a4be-4703f548c7ef None None] Enqueued Resource ID: 64ad60b2-732a-4e8d-a718-df9516dc3c04 with Priority: HIGHEST for action port [10120.640632] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64ad60b2-732a-4e8d-a718-df9516dc3c04 with Priority: HIGHEST for action port [10120.640918] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-64ad60b2-732a-4e8d-a718-df9516dc3c04 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.641073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64ad60b2-732a-4e8d-a718-df9516dc3c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.641211] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64ad60b2-732a-4e8d-a718-df9516dc3c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.641429] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64ad60b2-732a-4e8d-a718-df9516dc3c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.641528] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64ad60b2-732a-4e8d-a718-df9516dc3c04',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10120.903578] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-b696069c-81a6-4243-95fa-f24b214bded3 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.903891] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.903891] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.904067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.904233] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.904339] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.904406] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.904559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.904648] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.904738] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.904883] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-b696069c-81a6-4243-95fa-f24b214bded3 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.904969] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.905099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.905313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.905441] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10120.905536] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10120.905597] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10120.905785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10120.905829] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.905897] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10120.905984] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10121.093353] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10121.123037] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10121.123037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10121.123037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10121.123684] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10121.123684] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.123684] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 already deleted. [10121.123684] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.143588] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64ad60b2-732a-4e8d-a718-df9516dc3c04 [10121.143829] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10121.144098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10121.144098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10121.144250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10121.144364] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.144464] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64ad60b2-732a-4e8d-a718-df9516dc3c04 already deleted. [10121.144545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64ad60b2-732a-4e8d-a718-df9516dc3c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.408836] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b696069c-81a6-4243-95fa-f24b214bded3: rpc.has_security_group_logging(os_id): False [10121.429868] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10121.430107] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10121.430810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10121.430810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10121.430810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.431018] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10121.431416] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10121.431544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10121.431728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10121.431812] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.432044] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10121.432154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10121.432218] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10121.433019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10121.433121] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.433340] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10121.433440] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10121.433505] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10121.433661] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10121.433733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.433823] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b696069c-81a6-4243-95fa-f24b214bded3 is going to be created. [10121.502948] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10121.503216] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10121.503275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10121.503479] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10121.503661] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.516680] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b696069c-81a6-4243-95fa-f24b214bded3 in Status: IN_PROGRESS for 2s [10121.597613] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10121.599229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10121.599229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10121.599229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10121.599229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.599648] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa1c2520-27f7-4185-a08f-749f3520871d is going to be created. [10121.662504] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10121.662793] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10121.662793] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10121.664459] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10121.664459] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10121.675790] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa1c2520-27f7-4185-a08f-749f3520871d in Status: UNINITIALIZED for 2s [10122.960284] env[65939]: INFO networking_nsxv3.common.synchronization [req-343c845f-119e-428e-a57c-181ee666a813 req-f391120f-eca7-4c59-9c6d-da038f93f4ae tempest-ServersAdminNegativeTestJSON-58030456 tempest-ServersAdminNegativeTestJSON-58030456-project-member] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10122.960846] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10122.961190] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10122.961395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10122.961395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10122.961597] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10122.961743] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10122.961840] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10122.961894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10122.962069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10122.962158] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10122.962302] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10123.346946] env[65939]: INFO networking_nsxv3.common.synchronization [None req-90a8c4c7-3057-4d52-805b-11f1d66361d6 None None] Enqueued Resource ID: 4bb33696-b56c-49dd-8889-092b0f13d977 with Priority: HIGHEST for action port [10123.347555] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb33696-b56c-49dd-8889-092b0f13d977 with Priority: HIGHEST for action port [10123.347852] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bb33696-b56c-49dd-8889-092b0f13d977 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10123.347968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bb33696-b56c-49dd-8889-092b0f13d977" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10123.348704] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bb33696-b56c-49dd-8889-092b0f13d977" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10123.348704] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bb33696-b56c-49dd-8889-092b0f13d977" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10123.348704] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bb33696-b56c-49dd-8889-092b0f13d977',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10123.468847] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10123.530096] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b696069c-81a6-4243-95fa-f24b214bded3 in Status: SUCCESS [10123.530096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10123.689733] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa1c2520-27f7-4185-a08f-749f3520871d in Status: SUCCESS [10123.689733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10123.689733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10123.689733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10123.689733] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10123.689733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10123.689733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10123.689733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10123.689733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10123.689733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10123.689733] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10123.838110] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10123.838479] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10123.838566] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10123.839204] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10123.839204] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10123.839204] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10123.839396] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10123.839487] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10123.839591] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10123.840643] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10123.840643] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10123.840643] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10123.840643] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10123.840643] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10123.840643] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10123.840643] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10123.851562] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bb33696-b56c-49dd-8889-092b0f13d977 [10123.851562] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10123.851562] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10123.851562] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10123.851848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10123.851848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10123.851848] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bb33696-b56c-49dd-8889-092b0f13d977 already deleted. [10123.851947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bb33696-b56c-49dd-8889-092b0f13d977" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10123.860260] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10123.860260] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10123.860417] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10123.860497] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10123.860912] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10123.861154] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10123.861307] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10123.862033] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10123.862213] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f6bce8a-f0e7-4034-8c7f-3c65dc549956',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10123.970447] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10124.192139] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1c2520-27f7-4185-a08f-749f3520871d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.192139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.192139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.192139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.192139] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.192139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.192139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.192537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.192537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.192537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.192965] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1c2520-27f7-4185-a08f-749f3520871d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.192965] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.192965] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.192965] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.193212] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.193212] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.193212] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.193453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.193453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.193453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.193572] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10124.364607] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.364869] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.365132] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.365474] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.365631] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.365788] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 1f6bce8a-f0e7-4034-8c7f-3c65dc549956 not found, creating... [10124.366079] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.366262] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.366408] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.366614] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.366751] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.369617] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.369617] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.369617] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.369821] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.369963] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.370392] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 1f6bce8a-f0e7-4034-8c7f-3c65dc549956 is going to be created. [10124.399676] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.399906] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.400036] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.400325] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.400557] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.400981] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.474272] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.474272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.474272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.474272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.474272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.474670] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be updated. [10124.538704] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.538946] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.538946] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.543030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.543030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.553547] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: IN_PROGRESS for 2s [10124.699163] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa1c2520-27f7-4185-a08f-749f3520871d: rpc.has_security_group_logging(os_id): False [10124.721781] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.722509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.722509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.722816] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.723512] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.724340] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.724610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.724775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.724988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.725320] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.725634] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.726484] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.726484] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.726959] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.727852] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.728081] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.728427] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.728427] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.728602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.729972] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.729972] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa1c2520-27f7-4185-a08f-749f3520871d is going to be created. [10124.790365] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10124.790524] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10124.790567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10124.791559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10124.791846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10124.804705] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa1c2520-27f7-4185-a08f-749f3520871d in Status: IN_PROGRESS for 2s [10125.239405] env[65939]: INFO networking_nsxv3.common.synchronization [req-343c845f-119e-428e-a57c-181ee666a813 req-3119bd14-f4e4-4d3f-a4a1-37d3817dbb34 service nova] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_rules [10125.240284] env[65939]: INFO networking_nsxv3.common.synchronization [req-343c845f-119e-428e-a57c-181ee666a813 req-3119bd14-f4e4-4d3f-a4a1-37d3817dbb34 service nova] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10125.240284] env[65939]: INFO networking_nsxv3.common.synchronization [req-343c845f-119e-428e-a57c-181ee666a813 req-3119bd14-f4e4-4d3f-a4a1-37d3817dbb34 service nova] Enqueued Resource ID: 1f6bce8a-f0e7-4034-8c7f-3c65dc549956 with Priority: HIGHEST for action port [10125.242049] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_rules [10125.242254] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10125.242296] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f6bce8a-f0e7-4034-8c7f-3c65dc549956 with Priority: HIGHEST for action port [10125.242625] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10125.242850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10125.242928] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10125.243173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10125.243293] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10125.247506] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10125.247506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10125.247830] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10125.247830] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10125.247973] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10125.248125] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10125.248206] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f6bce8a-f0e7-4034-8c7f-3c65dc549956',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10125.746527] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10125.746740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10125.752698] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f6bce8a-f0e7-4034-8c7f-3c65dc549956 with status ACTIVE [10125.753206] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10125.753388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10125.753474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10125.753695] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10125.753794] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10125.753995] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10125.754119] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10125.754167] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10125.754375] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10125.754497] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10125.754768] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10125.754955] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10125.754955] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10125.755460] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10125.755460] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10125.755460] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f6bce8a-f0e7-4034-8c7f-3c65dc549956 is going to be updated. [10125.783152] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10125.783316] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10125.783384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10125.783586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10125.783721] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10125.784054] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f6bce8a-f0e7-4034-8c7f-3c65dc549956" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10126.564107] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: SUCCESS [10126.564593] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10126.564646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10126.564947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10126.565228] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10126.565652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10126.565652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10126.565737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10126.568471] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10126.568471] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10126.634233] env[65939]: INFO networking_nsxv3.common.synchronization [None req-7f58118b-cdb8-4523-ab49-850f6642a7e0 None None] Enqueued Resource ID: 960088e8-6d4b-4e61-89f3-b07ae197ad7d with Priority: HIGHEST for action port [10126.635167] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960088e8-6d4b-4e61-89f3-b07ae197ad7d with Priority: HIGHEST for action port [10126.635478] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-960088e8-6d4b-4e61-89f3-b07ae197ad7d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10126.635767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-960088e8-6d4b-4e61-89f3-b07ae197ad7d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10126.635767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-960088e8-6d4b-4e61-89f3-b07ae197ad7d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10126.636226] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-960088e8-6d4b-4e61-89f3-b07ae197ad7d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10126.636319] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('960088e8-6d4b-4e61-89f3-b07ae197ad7d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10126.818579] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa1c2520-27f7-4185-a08f-749f3520871d in Status: SUCCESS [10126.818800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10127.070080] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10127.138747] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 960088e8-6d4b-4e61-89f3-b07ae197ad7d [10127.138984] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10127.139130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10127.139198] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10127.139418] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10127.139513] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10127.139745] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:960088e8-6d4b-4e61-89f3-b07ae197ad7d already deleted. [10127.140259] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-960088e8-6d4b-4e61-89f3-b07ae197ad7d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10127.575646] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10127.961722] env[65939]: INFO networking_nsxv3.common.synchronization [None req-eace1a37-2a40-44de-9e4e-ebb0ec096248 None None] Enqueued Resource ID: 7ffd783c-ecc2-496d-ac00-63111f43f620 with Priority: HIGHEST for action port [10127.962645] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffd783c-ecc2-496d-ac00-63111f43f620 with Priority: HIGHEST for action port [10127.962785] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ffd783c-ecc2-496d-ac00-63111f43f620 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10127.963381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ffd783c-ecc2-496d-ac00-63111f43f620" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10127.963381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ffd783c-ecc2-496d-ac00-63111f43f620" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10127.963381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ffd783c-ecc2-496d-ac00-63111f43f620" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10127.963381] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ffd783c-ecc2-496d-ac00-63111f43f620',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10128.078466] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10128.078672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10128.078733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10128.078959] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10128.079070] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10128.079599] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be updated. [10128.110368] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10128.111262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10128.111262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10128.111262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10128.111262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10128.123675] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: IN_PROGRESS for 2s [10128.465354] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ffd783c-ecc2-496d-ac00-63111f43f620 [10128.465618] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10128.465777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10128.465848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10128.466078] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10128.466192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10128.466278] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ffd783c-ecc2-496d-ac00-63111f43f620 already deleted. [10128.466363] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ffd783c-ecc2-496d-ac00-63111f43f620" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10129.873841] env[65939]: INFO networking_nsxv3.common.synchronization [req-501cb5d3-e06d-4d8e-971b-808de2d7681d req-aa239dd2-1ca6-4787-a652-1daad13e3334 tempest-TenantUsagesTestJSON-548157220 tempest-TenantUsagesTestJSON-548157220-project-member] Enqueued Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGHEST for action security_group_members [10129.874597] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGHEST for action security_group_members [10129.874914] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-99711482-089a-4472-8ac3-fb1d995ba6dd taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10129.875104] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10129.875200] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10129.875436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10129.875625] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10129.875764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10129.875853] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10129.876086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10129.876983] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10129.877249] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10130.139532] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: SUCCESS [10130.139598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.140209] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.140453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.140666] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.140848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.140848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.140969] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.141063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.141160] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.141313] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10130.168374] env[65939]: INFO networking_nsxv3.common.synchronization [req-67f0c0b7-e5fa-417b-b4b7-9f595b93de00 req-5f8b6dd5-c034-4d92-8e23-cdb868b256ef tempest-ServersWithSpecificFlavorTestJSON-1136329551 tempest-ServersWithSpecificFlavorTestJSON-1136329551-project-member] Enqueued Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_members [10130.169039] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_members [10130.169382] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.169575] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.169671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.169867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.170017] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.172016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.172095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.172324] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.172465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.172524] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10130.384524] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.385420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.385420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.385420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.385420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.385420] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.385837] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.385837] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.385837] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.385837] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.385837] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99711482-089a-4472-8ac3-fb1d995ba6dd is going to be updated. [10130.422768] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.423326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.423326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.423465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.424301] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.433827] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99711482-089a-4472-8ac3-fb1d995ba6dd in Status: IN_PROGRESS for 2s [10130.644221] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.644459] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.644535] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.644752] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.645000] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.645131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.645321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.645622] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.645767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.645969] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.646838] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.646970] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.647051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.647308] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.647478] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.647574] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.647633] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.647785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.647861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.647968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.651624] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10130.656642] env[65939]: INFO networking_nsxv3.common.synchronization [None req-99bd3848-f0f0-46b3-abf4-25ef71128864 None None] Enqueued Resource ID: 6ae9d552-f892-481d-97ea-5543fc1cf2dc with Priority: HIGHEST for action port [10130.657132] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae9d552-f892-481d-97ea-5543fc1cf2dc with Priority: HIGHEST for action port [10130.657473] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ae9d552-f892-481d-97ea-5543fc1cf2dc taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.658268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ae9d552-f892-481d-97ea-5543fc1cf2dc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.658268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ae9d552-f892-481d-97ea-5543fc1cf2dc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.658268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ae9d552-f892-481d-97ea-5543fc1cf2dc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.659945] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae9d552-f892-481d-97ea-5543fc1cf2dc',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10130.677574] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.677812] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.677998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.679525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.679525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.679525] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.679525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.679525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.679525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.679525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.679525] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 already deleted. [10130.679525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.686961] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.687268] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-749" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.687827] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-749" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.688070] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-749" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.688333] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.688548] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.688665] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.688875] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.689017] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.689223] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10130.689330] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10130.689434] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10130.689606] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10130.689912] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10130.689912] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10130.689912] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10130.710998] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10130.711183] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10130.711399] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10130.711633] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-749" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10130.711949] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-6501e089-e4ff-4782-99c8-8464318f9c04 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10130.712140] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-6501e089-e4ff-4782-99c8-8464318f9c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10130.712319] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-6501e089-e4ff-4782-99c8-8464318f9c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10130.712578] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-6501e089-e4ff-4782-99c8-8464318f9c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10130.712690] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6501e089-e4ff-4782-99c8-8464318f9c04',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10131.154866] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32: rpc.has_security_group_logging(os_id): False [10131.163238] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ae9d552-f892-481d-97ea-5543fc1cf2dc [10131.163238] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.163238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.163238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.163238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.163238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.163238] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ae9d552-f892-481d-97ea-5543fc1cf2dc already deleted. [10131.163238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ae9d552-f892-481d-97ea-5543fc1cf2dc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.172914] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.175425] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.175425] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.175425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.176055] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.176375] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.176634] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.176841] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.177096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.177408] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.177589] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be updated. [10131.219158] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.219510] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.219708] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.220115] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.220374] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.220616] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 6501e089-e4ff-4782-99c8-8464318f9c04 not found, creating... [10131.220994] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.221247] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.221401] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.221816] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.222090] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.222548] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.222849] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.223072] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.223225] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.223389] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.223659] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 6501e089-e4ff-4782-99c8-8464318f9c04 is going to be created. [10131.250420] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.250789] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.250789] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.251075] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.251324] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.251600] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-6501e089-e4ff-4782-99c8-8464318f9c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.266620] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.266850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.266952] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.267353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.267547] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.287764] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: IN_PROGRESS for 2s [10131.978214] env[65939]: INFO networking_nsxv3.common.synchronization [req-3b0aa5dc-5b03-4bd7-af05-ae550706e09c req-f8f86578-9847-47fd-80f9-0be6a51e4966 tempest-ServerDiagnosticsTest-1245518893 tempest-ServerDiagnosticsTest-1245518893-project-member] Enqueued Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGHEST for action security_group_members [10131.979533] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGHEST for action security_group_members [10131.980446] env[65939]: INFO networking_nsxv3.common.synchronization [req-67f0c0b7-e5fa-417b-b4b7-9f595b93de00 req-3f061a4c-7010-4e6d-bf88-e837a7a02ceb service nova] Enqueued Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_rules [10131.980813] env[65939]: INFO networking_nsxv3.common.synchronization [req-67f0c0b7-e5fa-417b-b4b7-9f595b93de00 req-3f061a4c-7010-4e6d-bf88-e837a7a02ceb service nova] Enqueued Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_members [10131.980813] env[65939]: INFO networking_nsxv3.common.synchronization [req-67f0c0b7-e5fa-417b-b4b7-9f595b93de00 req-3f061a4c-7010-4e6d-bf88-e837a7a02ceb service nova] Enqueued Resource ID: 6501e089-e4ff-4782-99c8-8464318f9c04 with Priority: HIGHEST for action port [10131.981067] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.981188] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.981553] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.981553] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.981716] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.981716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.981799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.981867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.981957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.982099] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10131.983966] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_rules [10131.984115] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_members [10131.984212] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6501e089-e4ff-4782-99c8-8464318f9c04 with Priority: HIGHEST for action port [10131.985597] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.985722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.985937] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.985994] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.986054] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10131.986787] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.986896] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.986963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.987327] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.987560] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.987619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.987668] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.987849] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.988182] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10131.988280] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10131.989032] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-6501e089-e4ff-4782-99c8-8464318f9c04 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10131.989130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6501e089-e4ff-4782-99c8-8464318f9c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10131.989190] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6501e089-e4ff-4782-99c8-8464318f9c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10131.989338] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6501e089-e4ff-4782-99c8-8464318f9c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10131.989412] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6501e089-e4ff-4782-99c8-8464318f9c04',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10132.202606] env[65939]: INFO networking_nsxv3.common.synchronization [req-38dc5c6e-d67e-4313-8d9b-7a85b9a10976 req-35dfab12-c590-450c-a1f9-fb1b091d3520 tempest-DeleteServersAdminTestJSON-1634196934 tempest-DeleteServersAdminTestJSON-1634196934-project-admin] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10132.202955] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10132.203046] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.203171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.203238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.203428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.204288] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.204440] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.208019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.208019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.208019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.208019] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10132.445784] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99711482-089a-4472-8ac3-fb1d995ba6dd in Status: SUCCESS [10132.445784] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99711482-089a-4472-8ac3-fb1d995ba6dd deletion is rescheduled due to dependency. [10132.445784] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.486140] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.486925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.486925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.486925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.487131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.487329] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.487329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.487463] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.487683] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.487777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.487944] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 is going to be updated. [10132.490608] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.491407] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.492060] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10132.492872] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6501e089-e4ff-4782-99c8-8464318f9c04 with status ACTIVE [10132.493080] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.493185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.493249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.493454] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.493569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.493740] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.493854] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.493951] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.494080] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.494163] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.494461] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.494461] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.494588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.494619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.494680] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.494773] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6501e089-e4ff-4782-99c8-8464318f9c04 is going to be updated. [10132.514848] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.514997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.515074] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.515284] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.515417] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.515580] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6501e089-e4ff-4782-99c8-8464318f9c04" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.516680] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.516767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.516767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.516995] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.517089] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.527764] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 in Status: IN_PROGRESS for 2s [10132.563105] env[65939]: INFO networking_nsxv3.common.synchronization [None req-d4f6039d-a9fc-4af2-957a-4a84e88d1fbb tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_rules [10132.563105] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_rules [10132.563105] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.563105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.563105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.563105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.563105] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10132.707563] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.707812] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.707870] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.708108] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.708259] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.708440] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.708538] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.708598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.708753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.708829] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.708915] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be updated. [10132.754873] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.755053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.755245] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10132.756628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10132.756628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10132.773276] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: IN_PROGRESS for 2s [10132.854210] env[65939]: INFO networking_nsxv3.common.synchronization [None req-82c94f3d-ad7a-426b-a08d-3224c1bbb883 tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_rules [10132.854741] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_rules [10132.855048] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10132.855169] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10132.999158] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10133.092103] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10133.092103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10133.092103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10133.092103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10133.092103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10133.092103] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e already deleted. [10133.092103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10133.092103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10133.092103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10133.092103] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10133.319998] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: SUCCESS [10133.320343] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10133.502974] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10133.503153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10133.503222] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10133.503531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10133.503531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10133.503659] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 is going to be created. [10133.529399] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10133.529475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10133.529503] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10133.529703] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10133.529860] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10133.541190] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4415b353-eee7-421d-a222-35308d9d05b7 in Status: UNINITIALIZED for 2s [10133.618577] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10133.618838] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10133.619029] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10133.619351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10133.619627] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10133.620202] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e already deleted. [10133.620405] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10133.670512] env[65939]: INFO networking_nsxv3.common.synchronization [req-7e3bc022-8d58-4da0-bd4f-fe86f5bb464a req-3668a2d9-a1d8-4984-8839-2d654e72ce82 tempest-ServersAdminTestJSON-304522112 tempest-ServersAdminTestJSON-304522112-project-member] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10133.672567] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10133.672567] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10133.673550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10133.673550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10133.673550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10133.673550] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10133.673550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10133.673550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10133.673550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10133.674674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10133.674674] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10134.016282] env[65939]: INFO networking_nsxv3.common.synchronization [None req-d08e3cca-d2cb-4bb8-a657-05ef7bb7ea76 None None] Enqueued Resource ID: 0a6c5763-cafd-4a49-9729-cf4600ebd822 with Priority: HIGHEST for action port [10134.016373] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a6c5763-cafd-4a49-9729-cf4600ebd822 with Priority: HIGHEST for action port [10134.016684] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a6c5763-cafd-4a49-9729-cf4600ebd822 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.016774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a6c5763-cafd-4a49-9729-cf4600ebd822" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.016841] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a6c5763-cafd-4a49-9729-cf4600ebd822" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.019337] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a6c5763-cafd-4a49-9729-cf4600ebd822" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.019554] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a6c5763-cafd-4a49-9729-cf4600ebd822',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10134.141897] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.144058] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.144541] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.144699] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.144975] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.148020] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.148020] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.148020] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.148020] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.148020] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10134.148020] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10134.148020] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10134.148020] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10134.148020] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10134.148020] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10134.148020] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Looking for TransportZone with name nsx-vlan-transportzone. [10134.166763] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10134.167107] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10134.167212] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10134.167507] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.167852] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock port-2f32903c-9de2-490b-be90-dc5202ba445b taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.168131] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "port-2f32903c-9de2-490b-be90-dc5202ba445b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.168223] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "port-2f32903c-9de2-490b-be90-dc5202ba445b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.168729] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "port-2f32903c-9de2-490b-be90-dc5202ba445b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.168729] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f32903c-9de2-490b-be90-dc5202ba445b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10134.178502] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.178656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.178743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.179057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.179160] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.179369] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.179490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.179554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.179902] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.179902] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.179902] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d already deleted. [10134.180336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.522319] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a6c5763-cafd-4a49-9729-cf4600ebd822 [10134.522602] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.522705] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.522774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.522987] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.523089] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.523186] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a6c5763-cafd-4a49-9729-cf4600ebd822 already deleted. [10134.523268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a6c5763-cafd-4a49-9729-cf4600ebd822" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.538168] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 in Status: SUCCESS [10134.538168] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 deletion is rescheduled due to dependency. [10134.538168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.673329] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.673522] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.673650] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.673952] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.674119] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.674263] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Segment Port 2f32903c-9de2-490b-be90-dc5202ba445b not found, creating... [10134.674528] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.674684] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.674796] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.675012] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.675160] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.675449] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.675604] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.675716] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.675921] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.676490] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.676703] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Resource: SegmentPort with ID: 2f32903c-9de2-490b-be90-dc5202ba445b is going to be created. [10134.700326] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10134.701472] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10134.701472] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10134.701472] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10134.701472] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.703678] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "port-2f32903c-9de2-490b-be90-dc5202ba445b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10134.784061] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: SUCCESS [10134.784229] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 deletion is rescheduled due to dependency. [10134.784510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10135.476533] env[65939]: INFO networking_nsxv3.common.synchronization [req-7e3bc022-8d58-4da0-bd4f-fe86f5bb464a req-71b8eedc-e7e1-4ca7-b6e5-e023221bafa1 service nova] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_rules [10135.476904] env[65939]: INFO networking_nsxv3.common.synchronization [req-7e3bc022-8d58-4da0-bd4f-fe86f5bb464a req-71b8eedc-e7e1-4ca7-b6e5-e023221bafa1 service nova] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10135.476904] env[65939]: INFO networking_nsxv3.common.synchronization [req-7e3bc022-8d58-4da0-bd4f-fe86f5bb464a req-71b8eedc-e7e1-4ca7-b6e5-e023221bafa1 service nova] Enqueued Resource ID: 2f32903c-9de2-490b-be90-dc5202ba445b with Priority: HIGHEST for action port [10135.477677] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_rules [10135.477766] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10135.477842] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f32903c-9de2-490b-be90-dc5202ba445b with Priority: HIGHEST for action port [10135.478456] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10135.478456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10135.478654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10135.479268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10135.479363] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10135.480432] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10135.481121] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10135.483085] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10135.483085] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10135.483085] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10135.483085] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10135.483085] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10135.483085] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10135.483085] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10135.483085] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10135.484637] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f32903c-9de2-490b-be90-dc5202ba445b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10135.484770] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f32903c-9de2-490b-be90-dc5202ba445b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10135.485566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f32903c-9de2-490b-be90-dc5202ba445b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10135.485861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f32903c-9de2-490b-be90-dc5202ba445b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10135.486682] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f32903c-9de2-490b-be90-dc5202ba445b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10135.553526] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4415b353-eee7-421d-a222-35308d9d05b7 in Status: SUCCESS [10135.554258] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10135.554258] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10135.555067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10135.555067] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10135.555067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10135.555067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10135.557204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10135.557491] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10135.557666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10135.557830] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10135.988306] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10135.989621] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10135.989756] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10135.990148] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f32903c-9de2-490b-be90-dc5202ba445b with status ACTIVE [10135.990363] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10135.990515] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10135.990619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10135.994399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10135.994739] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10135.995291] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10135.995732] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10135.996599] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10135.996907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10135.997153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10135.997541] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10135.998303] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10135.999015] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10135.999451] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10135.999672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10136.000538] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f32903c-9de2-490b-be90-dc5202ba445b is going to be updated. [10136.050503] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10136.050831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10136.050831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10136.051113] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10136.051284] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10136.051539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f32903c-9de2-490b-be90-dc5202ba445b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10136.063819] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10136.146174] env[65939]: INFO networking_nsxv3.common.synchronization [None req-19798705-a8fe-45b6-8ffc-12a44d650dd5 None None] Enqueued Resource ID: 4c3bc7e6-b4ed-416f-8e4a-37ee12c62020 with Priority: HIGHEST for action port [10136.146856] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3bc7e6-b4ed-416f-8e4a-37ee12c62020 with Priority: HIGHEST for action port [10136.150506] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c3bc7e6-b4ed-416f-8e4a-37ee12c62020 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10136.150818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c3bc7e6-b4ed-416f-8e4a-37ee12c62020" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10136.150869] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c3bc7e6-b4ed-416f-8e4a-37ee12c62020" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10136.151152] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c3bc7e6-b4ed-416f-8e4a-37ee12c62020" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10136.151239] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3bc7e6-b4ed-416f-8e4a-37ee12c62020',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10136.490432] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10136.567550] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4415b353-eee7-421d-a222-35308d9d05b7: rpc.has_security_group_logging(os_id): False [10136.597161] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10136.597161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10136.597161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10136.597161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10136.597161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10136.597161] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10136.597161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10136.597161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10136.597161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10136.597161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10136.597161] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 is going to be created. [10136.655335] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c3bc7e6-b4ed-416f-8e4a-37ee12c62020 [10136.656907] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10136.656907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10136.656907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10136.656907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10136.656907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10136.656907] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c3bc7e6-b4ed-416f-8e4a-37ee12c62020 already deleted. [10136.656907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c3bc7e6-b4ed-416f-8e4a-37ee12c62020" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10136.676052] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10136.676299] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10136.676427] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10136.676693] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10136.676886] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10136.692419] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4415b353-eee7-421d-a222-35308d9d05b7 in Status: IN_PROGRESS for 2s [10136.996066] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10136.996066] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10136.996066] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10136.996242] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10136.996764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10136.996963] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be created. [10137.024014] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10137.024014] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10137.024177] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10137.024437] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10137.024892] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10137.037589] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: UNINITIALIZED for 2s [10137.504174] env[65939]: INFO networking_nsxv3.common.synchronization [req-d86472a0-387f-4bb3-b650-6853b9c281fa req-31603eaf-5118-417f-a70b-1e5303fc0165 tempest-ServersAdminTestJSON-304522112 tempest-ServersAdminTestJSON-304522112-project-member] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10137.504174] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10137.504174] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10137.506555] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10137.557901] env[65939]: INFO networking_nsxv3.common.synchronization [None req-dfbfa1fd-5c0c-4182-8a94-5b735ce8eab5 None None] Enqueued Resource ID: b03da784-5c71-406f-8ae8-01dc66798cee with Priority: HIGHEST for action port [10137.558133] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b03da784-5c71-406f-8ae8-01dc66798cee with Priority: HIGHEST for action port [10137.558504] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-b03da784-5c71-406f-8ae8-01dc66798cee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10137.558899] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b03da784-5c71-406f-8ae8-01dc66798cee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10137.558899] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b03da784-5c71-406f-8ae8-01dc66798cee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10137.559029] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b03da784-5c71-406f-8ae8-01dc66798cee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10137.559227] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b03da784-5c71-406f-8ae8-01dc66798cee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10138.062989] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b03da784-5c71-406f-8ae8-01dc66798cee [10138.063267] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10138.063394] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10138.063467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10138.063685] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10138.063782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10138.063887] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b03da784-5c71-406f-8ae8-01dc66798cee already deleted. [10138.063969] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b03da784-5c71-406f-8ae8-01dc66798cee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10138.069414] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10138.069608] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10138.069729] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10138.069995] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10138.070250] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10138.070403] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10138.070515] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10138.070725] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10138.070859] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10138.071213] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10138.071387] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10138.071543] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10138.071691] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10138.071858] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10138.072042] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10138.072206] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10138.095141] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10138.095422] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10138.095880] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10138.096375] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10138.096644] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10138.096933] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10138.097153] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10138.097663] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10138.097909] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10138.600551] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10138.600836] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10138.601028] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10138.601412] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10138.601626] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10138.601833] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 not found, creating... [10138.602204] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10138.602428] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10138.602615] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10138.603084] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10138.603305] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10138.603794] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10138.604034] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10138.604223] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10138.604446] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10138.604580] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10138.604718] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 is going to be created. [10138.626082] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10138.626310] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10138.626433] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10138.626701] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10138.627033] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10138.627383] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10138.706243] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4415b353-eee7-421d-a222-35308d9d05b7 in Status: SUCCESS [10138.708372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10139.051263] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10139.051263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10139.051263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10139.051263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10139.051263] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.051519] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.051519] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10139.051569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10139.051614] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10139.051697] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10139.051868] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10139.053050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10139.053493] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10139.053678] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.053788] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.053850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10139.055171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10139.055171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10139.055171] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10139.356040] env[65939]: INFO networking_nsxv3.common.synchronization [req-d86472a0-387f-4bb3-b650-6853b9c281fa req-671efe78-d7fc-4806-aa61-c61d3299932b service nova] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_rules [10139.356303] env[65939]: INFO networking_nsxv3.common.synchronization [req-d86472a0-387f-4bb3-b650-6853b9c281fa req-671efe78-d7fc-4806-aa61-c61d3299932b service nova] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10139.356364] env[65939]: INFO networking_nsxv3.common.synchronization [req-d86472a0-387f-4bb3-b650-6853b9c281fa req-671efe78-d7fc-4806-aa61-c61d3299932b service nova] Enqueued Resource ID: b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 with Priority: HIGHEST for action port [10139.356909] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_rules [10139.357552] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10139.357825] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 with Priority: HIGHEST for action port [10139.358259] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.358454] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.358838] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.359015] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.359669] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.359874] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.360035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10139.360340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10139.360515] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10139.556496] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.556672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.561841] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10139.865955] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 with status ACTIVE [10139.865955] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.866140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.866249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10139.866475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10139.868679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10139.868679] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.868679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.868679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10139.868679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10139.868679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10139.868679] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.868679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.868679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10139.868679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10139.868679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10139.868679] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 is going to be updated. [10139.895702] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10139.895702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10139.895702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10139.896098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10139.896098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10139.896302] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10140.064877] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10140.404759] env[65939]: INFO networking_nsxv3.common.synchronization [None req-37686da4-9494-4f73-ab4b-15a50ad7e24f None None] Enqueued Resource ID: 0f53d0ad-09fc-4693-b7b9-d1c8722f00fc with Priority: HIGHEST for action port [10140.404759] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f53d0ad-09fc-4693-b7b9-d1c8722f00fc with Priority: HIGHEST for action port [10140.404759] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f53d0ad-09fc-4693-b7b9-d1c8722f00fc taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10140.404759] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f53d0ad-09fc-4693-b7b9-d1c8722f00fc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10140.405140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f53d0ad-09fc-4693-b7b9-d1c8722f00fc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10140.406867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f53d0ad-09fc-4693-b7b9-d1c8722f00fc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10140.407150] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f53d0ad-09fc-4693-b7b9-d1c8722f00fc',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10140.567846] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10140.567846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10140.567846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10140.567846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10140.567846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10140.567846] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10140.600998] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10140.601180] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10140.601278] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10140.603061] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10140.603061] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10140.613847] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10140.914171] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f53d0ad-09fc-4693-b7b9-d1c8722f00fc [10140.914171] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10140.914171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10140.914171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10140.914171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10140.914171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10140.914171] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f53d0ad-09fc-4693-b7b9-d1c8722f00fc already deleted. [10140.914171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f53d0ad-09fc-4693-b7b9-d1c8722f00fc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10141.542690] env[65939]: INFO networking_nsxv3.common.synchronization [req-114977c0-c9c2-47d7-91fc-f83bd08b9569 req-5328704e-f067-424b-824c-3bde9118ca53 tempest-SecurityGroupRulesTestJSON-1313565084 tempest-SecurityGroupRulesTestJSON-1313565084-project-member] Enqueued Resource ID: 290220c2-c479-4b05-af41-42dc19ac2357 with Priority: HIGHEST for action security_group_rules [10141.542690] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290220c2-c479-4b05-af41-42dc19ac2357 with Priority: HIGHEST for action security_group_rules [10141.542690] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-290220c2-c479-4b05-af41-42dc19ac2357 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10141.542690] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-290220c2-c479-4b05-af41-42dc19ac2357" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10141.543449] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-290220c2-c479-4b05-af41-42dc19ac2357" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10141.543751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-290220c2-c479-4b05-af41-42dc19ac2357" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10141.543847] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('290220c2-c479-4b05-af41-42dc19ac2357',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10142.086512] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10142.086805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10142.086805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10142.087033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10142.087111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10142.087211] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 290220c2-c479-4b05-af41-42dc19ac2357 already deleted. [10142.087313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-290220c2-c479-4b05-af41-42dc19ac2357" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10142.633692] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10142.634622] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10142.634893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10142.635314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10142.635607] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10142.638672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10142.638672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10142.638672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10142.638672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10142.638672] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10143.141510] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10143.647863] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10144.150990] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10144.151245] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10144.151334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10144.151721] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10144.151846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10144.151958] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10144.187489] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10144.187489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10144.187489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10144.187740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10144.187740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10144.198103] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10144.875479] env[65939]: INFO networking_nsxv3.common.synchronization [req-45a83a8c-9bc7-495e-abe4-9ca04d447318 req-e50569ce-ce1d-4340-b462-4876b78e15b5 tempest-SecurityGroupRulesTestJSON-1313565084 tempest-SecurityGroupRulesTestJSON-1313565084-project-member] Enqueued Resource ID: 132a142b-7bfb-4d9a-af9d-a1778c30988c with Priority: HIGHEST for action security_group_rules [10144.875929] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 132a142b-7bfb-4d9a-af9d-a1778c30988c with Priority: HIGHEST for action security_group_rules [10144.875929] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-132a142b-7bfb-4d9a-af9d-a1778c30988c taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10144.876376] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-132a142b-7bfb-4d9a-af9d-a1778c30988c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10144.876376] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-132a142b-7bfb-4d9a-af9d-a1778c30988c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10144.876376] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-132a142b-7bfb-4d9a-af9d-a1778c30988c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10144.876946] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('132a142b-7bfb-4d9a-af9d-a1778c30988c',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10145.332669] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b1059324-1668-4d29-bb04-5815bc314a43 None None] Enqueued Resource ID: 73fdbea5-8395-454b-a04a-0af62c71cac2 with Priority: HIGHEST for action port [10145.333222] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fdbea5-8395-454b-a04a-0af62c71cac2 with Priority: HIGHEST for action port [10145.333628] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-73fdbea5-8395-454b-a04a-0af62c71cac2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10145.333822] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73fdbea5-8395-454b-a04a-0af62c71cac2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10145.333949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73fdbea5-8395-454b-a04a-0af62c71cac2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10145.334304] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73fdbea5-8395-454b-a04a-0af62c71cac2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10145.334432] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73fdbea5-8395-454b-a04a-0af62c71cac2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10145.410195] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10145.410195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10145.410195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10145.410195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10145.410195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10145.410195] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 132a142b-7bfb-4d9a-af9d-a1778c30988c already deleted. [10145.410195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-132a142b-7bfb-4d9a-af9d-a1778c30988c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10145.710801] env[65939]: INFO networking_nsxv3.common.synchronization [req-f2061c6d-fe1c-4513-91d9-b167fdea1acb req-4c971833-e394-4f63-b13d-3dcccb450612 tempest-ServerAddressesNegativeTestJSON-1001871260 tempest-ServerAddressesNegativeTestJSON-1001871260-project-member] Enqueued Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGHEST for action security_group_members [10145.711011] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGHEST for action security_group_members [10145.711232] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-b696069c-81a6-4243-95fa-f24b214bded3 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10145.711351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10145.711418] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10145.711615] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10145.711766] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10145.711899] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10145.711926] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10145.712149] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10145.712297] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10145.712415] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10145.843436] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73fdbea5-8395-454b-a04a-0af62c71cac2 [10145.843683] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10145.843820] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10145.843894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10145.844143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10145.844327] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10145.844327] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73fdbea5-8395-454b-a04a-0af62c71cac2 already deleted. [10145.844423] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73fdbea5-8395-454b-a04a-0af62c71cac2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.149169] env[65939]: INFO networking_nsxv3.common.synchronization [req-785b6bc3-92af-458b-9429-5fbb03141f6c req-63c70510-e233-42e0-812a-55b4379f0f90 tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_members [10146.149988] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_members [10146.151850] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.151850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.151850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.152192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.152333] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.152399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.152474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.152656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.152783] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.152904] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10146.211634] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10146.211701] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.211909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.212230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.212549] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.212776] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.212868] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.213826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.214763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.214946] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.215945] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.215945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.215945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.215945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.216152] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.216152] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.216226] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.216559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.217610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.217610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.217610] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10146.220754] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.220975] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.221076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.221312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.227567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.227567] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.227567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.227567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.227567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.227567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.227567] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b696069c-81a6-4243-95fa-f24b214bded3 is going to be updated. [10146.258953] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.259179] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.259179] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.259373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.260318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.271805] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b696069c-81a6-4243-95fa-f24b214bded3 in Status: IN_PROGRESS for 2s [10146.655451] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.655660] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.655734] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.655970] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.656075] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.656312] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.656433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.656500] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.656681] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.656763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.656876] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e already deleted. [10146.656960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.690461] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.691439] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "network-210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.691439] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "network-210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.691439] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "network-210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.691606] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.691681] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.691717] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.692392] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.692572] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.692794] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10146.692923] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10146.693023] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10146.693132] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10146.693239] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10146.693343] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10146.693484] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Looking for TransportZone with name nsx-vlan-transportzone. [10146.718823] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10146.719194] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10146.719194] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10146.719622] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "network-210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.719957] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.720162] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.720298] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.720784] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.720895] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b7c522-c8e1-4a7d-98b9-88c072af00ad',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10146.725077] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4361c451-dad4-41c4-b71f-bbfd50f8ea0d: rpc.has_security_group_logging(os_id): False [10146.749351] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.749351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.749351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.749351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.749351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.749607] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.749607] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.749607] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.749760] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.749907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.750105] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.750463] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.750463] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.750463] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.750631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.750675] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.750750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.750809] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.750934] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.751022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.752800] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be created. [10146.825448] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10146.825545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10146.825657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10146.825845] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10146.826053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10146.839156] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10147.223705] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10147.224204] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10147.224204] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10147.224343] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10147.224479] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10147.224628] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Segment Port d6b7c522-c8e1-4a7d-98b9-88c072af00ad not found, creating... [10147.224873] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10147.225036] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10147.225155] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10147.225951] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10147.225951] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10147.225951] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10147.225951] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10147.226206] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10147.226357] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10147.226486] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10147.226616] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Resource: SegmentPort with ID: d6b7c522-c8e1-4a7d-98b9-88c072af00ad is going to be created. [10147.257519] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10147.257801] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10147.257923] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10147.258275] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10147.258506] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10147.258738] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10147.713930] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ee3f0ca2-5b66-4620-97b8-0ba9777cf8c8 None None] Enqueued Resource ID: 9044609e-cb90-446b-a97d-bea955c4f769 with Priority: HIGHEST for action port [10147.714938] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9044609e-cb90-446b-a97d-bea955c4f769 with Priority: HIGHEST for action port [10147.715591] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-9044609e-cb90-446b-a97d-bea955c4f769 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10147.716360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9044609e-cb90-446b-a97d-bea955c4f769" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10147.716360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9044609e-cb90-446b-a97d-bea955c4f769" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10147.716360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9044609e-cb90-446b-a97d-bea955c4f769" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10147.720428] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9044609e-cb90-446b-a97d-bea955c4f769',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10147.984194] env[65939]: INFO networking_nsxv3.common.synchronization [req-785b6bc3-92af-458b-9429-5fbb03141f6c req-a78ca612-8841-4934-8696-de789ff90a6b service nova] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_rules [10147.984760] env[65939]: INFO networking_nsxv3.common.synchronization [req-785b6bc3-92af-458b-9429-5fbb03141f6c req-a78ca612-8841-4934-8696-de789ff90a6b service nova] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_members [10147.987903] env[65939]: INFO networking_nsxv3.common.synchronization [req-785b6bc3-92af-458b-9429-5fbb03141f6c req-a78ca612-8841-4934-8696-de789ff90a6b service nova] Enqueued Resource ID: d6b7c522-c8e1-4a7d-98b9-88c072af00ad with Priority: HIGHEST for action port [10147.987903] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_rules [10147.987903] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_members [10147.987903] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b7c522-c8e1-4a7d-98b9-88c072af00ad with Priority: HIGHEST for action port [10147.987903] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10147.987903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10147.987903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10147.987903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10147.987903] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10147.991115] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10147.991605] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10147.992286] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10147.992714] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10147.993068] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10147.994635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10147.994635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10147.994635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10147.994635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10147.994635] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10147.995594] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10147.995909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10147.996108] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10147.996648] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10147.997074] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b7c522-c8e1-4a7d-98b9-88c072af00ad',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10148.224349] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9044609e-cb90-446b-a97d-bea955c4f769 [10148.224349] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10148.224349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10148.224349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10148.224349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10148.224349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.224349] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9044609e-cb90-446b-a97d-bea955c4f769 already deleted. [10148.224349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9044609e-cb90-446b-a97d-bea955c4f769" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.282626] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b696069c-81a6-4243-95fa-f24b214bded3 in Status: SUCCESS [10148.282626] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b696069c-81a6-4243-95fa-f24b214bded3 deletion is rescheduled due to dependency. [10148.282626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.374993] env[65939]: INFO networking_nsxv3.common.synchronization [None req-83726c81-01f0-417b-9a1d-b244da8801ea None None] Enqueued Resource ID: e59ca4be-06cb-45f0-830b-16b767254dfc with Priority: HIGHEST for action port [10148.375572] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e59ca4be-06cb-45f0-830b-16b767254dfc with Priority: HIGHEST for action port [10148.375872] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-e59ca4be-06cb-45f0-830b-16b767254dfc taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10148.376045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e59ca4be-06cb-45f0-830b-16b767254dfc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10148.377512] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e59ca4be-06cb-45f0-830b-16b767254dfc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10148.377779] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e59ca4be-06cb-45f0-830b-16b767254dfc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10148.377861] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e59ca4be-06cb-45f0-830b-16b767254dfc',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10148.492250] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10148.492397] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10148.506168] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10148.506168] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6b7c522-c8e1-4a7d-98b9-88c072af00ad with status ACTIVE [10148.506168] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10148.509623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10148.509873] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10148.510228] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10148.510347] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.510624] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10148.510766] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10148.511012] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10148.511692] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10148.512117] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.512117] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10148.512227] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10148.512490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10148.512490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10148.512587] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.512679] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6b7c522-c8e1-4a7d-98b9-88c072af00ad is going to be updated. [10148.541882] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10148.541882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10148.541882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10148.541882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10148.542087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.542126] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6b7c522-c8e1-4a7d-98b9-88c072af00ad" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.854289] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10148.854808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.854808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10148.855756] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10148.857572] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10148.882063] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e59ca4be-06cb-45f0-830b-16b767254dfc [10148.883237] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10148.883539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10148.883539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10148.884710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10148.884710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10148.884710] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e59ca4be-06cb-45f0-830b-16b767254dfc already deleted. [10148.884710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e59ca4be-06cb-45f0-830b-16b767254dfc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.015283] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10149.319645] env[65939]: INFO networking_nsxv3.common.synchronization [None req-668dd01d-c2c3-4a0a-9977-404e251f4b77 tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_rules [10149.320432] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_rules [10149.320521] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-152e138c-a16f-4ab1-ae1d-27177515f5d0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.320578] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.320617] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.322981] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.322981] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10149.358281] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.358281] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.358281] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.359090] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.359398] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.359527] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.359903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.359903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.359903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.360278] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.360278] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10149.521022] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.521022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.521022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.521022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.521022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.521022] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e is going to be created. [10149.544929] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.545054] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.545092] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.545282] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.545537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.556994] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: UNINITIALIZED for 2s [10149.744858] env[65939]: INFO networking_nsxv3.common.synchronization [req-266c8dd4-01a7-421e-88f2-571f8750dc2e req-f1816d24-48eb-419b-8f25-e888b97c5075 tempest-FloatingIPsAssociationTestJSON-1227248827 tempest-FloatingIPsAssociationTestJSON-1227248827-project-member] Enqueued Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGHEST for action security_group_members [10149.744858] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGHEST for action security_group_members [10149.744858] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.744858] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.744858] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.745136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.745283] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.745406] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.746406] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.746406] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.746406] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.746406] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10149.846516] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.846516] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.846715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.846831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.846950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.847071] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 already deleted. [10149.847159] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.864868] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.865041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.865132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.865355] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.865536] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.865646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.865711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.865859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.865971] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.866044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.866205] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.866318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.866360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.866506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.866653] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10149.866747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10149.866807] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10149.866943] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10149.867028] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.867110] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10149.867205] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10150.005735] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ddf2b232-4c9c-42d3-b5f8-8c1eaba53fe8 tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_rules [10150.006450] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_rules [10150.006831] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-152e138c-a16f-4ab1-ae1d-27177515f5d0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.007319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.007319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.007502] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.007671] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10150.248586] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.248802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.248879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.249114] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.249208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.249436] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.249575] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.249575] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.249703] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.249777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.250570] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa already deleted. [10150.250805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.369929] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4361c451-dad4-41c4-b71f-bbfd50f8ea0d: rpc.has_security_group_logging(os_id): False [10150.395550] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.395977] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.395977] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.397395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.397606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.397862] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.397989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.398068] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.398396] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.398396] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.398870] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.398870] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.398870] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.399210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.399210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.399210] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.399319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.399319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.399500] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.399560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.399660] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10150.508329] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.508506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.508661] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.508792] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.508920] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.538893] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.539186] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.539262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.539536] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.539679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.539795] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 already deleted. [10150.539914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.540865] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10150.757065] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-25 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.757350] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-25" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.758045] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-25" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.758045] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-25" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.760194] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.760457] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.760592] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.760885] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.761070] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.761338] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10150.761500] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10150.761679] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10150.761763] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10150.761884] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10150.762024] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10150.762184] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10150.786983] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10150.787873] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10150.787873] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10150.787949] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-25" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10150.788254] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-457c3391-d047-439c-9df9-3b1b715ca405 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10150.788672] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10150.788710] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10150.789124] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10150.789347] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457c3391-d047-439c-9df9-3b1b715ca405',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10151.295021] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10151.295021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10151.295021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10151.295021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10151.295021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10151.295021] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 457c3391-d047-439c-9df9-3b1b715ca405 not found, creating... [10151.295021] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10151.295021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10151.295021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10151.295021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10151.295021] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10151.295601] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10151.295601] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10151.295601] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10151.295601] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10151.295601] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10151.295601] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 457c3391-d047-439c-9df9-3b1b715ca405 is going to be created. [10151.322577] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10151.323098] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10151.323321] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10151.323686] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10151.324154] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10151.324486] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10151.508252] env[65939]: INFO networking_nsxv3.common.synchronization [None req-66635d03-aa1a-4147-a3cd-99102090c36f None None] Enqueued Resource ID: 22a6caa2-b57c-4092-b4b4-abf36407bf17 with Priority: HIGHEST for action port [10151.508837] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22a6caa2-b57c-4092-b4b4-abf36407bf17 with Priority: HIGHEST for action port [10151.509474] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-22a6caa2-b57c-4092-b4b4-abf36407bf17 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10151.509474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22a6caa2-b57c-4092-b4b4-abf36407bf17" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10151.509474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22a6caa2-b57c-4092-b4b4-abf36407bf17" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10151.509754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22a6caa2-b57c-4092-b4b4-abf36407bf17" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10151.509874] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22a6caa2-b57c-4092-b4b4-abf36407bf17',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10151.567264] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: SUCCESS [10151.567469] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10151.567652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10151.567868] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10151.568064] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10151.568525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10151.568525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10151.568525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10151.568525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10151.568667] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10151.568667] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10151.790906] env[65939]: INFO networking_nsxv3.common.synchronization [req-b1f56184-1b17-4b00-a3bc-09099ab98db6 req-579ad1de-465f-44f0-ade8-b6c74ea3f771 tempest-ServersNegativeTestMultiTenantJSON-1466868589 tempest-ServersNegativeTestMultiTenantJSON-1466868589-project-member] Enqueued Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGHEST for action security_group_members [10151.791454] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGHEST for action security_group_members [10151.791827] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1c2520-27f7-4185-a08f-749f3520871d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10151.791984] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10151.791984] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10151.792509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10151.792509] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10151.792509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10151.792509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10151.792720] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10151.792785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10151.792883] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10152.012437] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22a6caa2-b57c-4092-b4b4-abf36407bf17 [10152.013442] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.013596] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.013668] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.013894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.013990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.014099] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22a6caa2-b57c-4092-b4b4-abf36407bf17 already deleted. [10152.014184] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22a6caa2-b57c-4092-b4b4-abf36407bf17" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.034572] env[65939]: INFO networking_nsxv3.common.synchronization [req-266c8dd4-01a7-421e-88f2-571f8750dc2e req-22a6f4ce-ac9b-4e43-be57-776d6bd585ab service nova] Enqueued Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGHEST for action security_group_rules [10152.034745] env[65939]: INFO networking_nsxv3.common.synchronization [req-266c8dd4-01a7-421e-88f2-571f8750dc2e req-22a6f4ce-ac9b-4e43-be57-776d6bd585ab service nova] Enqueued Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGHEST for action security_group_members [10152.034871] env[65939]: INFO networking_nsxv3.common.synchronization [req-266c8dd4-01a7-421e-88f2-571f8750dc2e req-22a6f4ce-ac9b-4e43-be57-776d6bd585ab service nova] Enqueued Resource ID: 457c3391-d047-439c-9df9-3b1b715ca405 with Priority: HIGHEST for action port [10152.035391] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGHEST for action security_group_rules [10152.035552] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGHEST for action security_group_members [10152.035659] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457c3391-d047-439c-9df9-3b1b715ca405 with Priority: HIGHEST for action port [10152.035922] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.036516] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.036609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.036892] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.037023] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10152.037994] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.038161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.038271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.038712] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.038712] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.038855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.038942] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.039094] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.039380] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.039380] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10152.040115] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-457c3391-d047-439c-9df9-3b1b715ca405 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.040279] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.041215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.041441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.041543] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457c3391-d047-439c-9df9-3b1b715ca405',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10152.070326] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10152.295579] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.295802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.295847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.296159] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.296258] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.296472] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.296574] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.296631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.296798] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.296908] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.297050] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa1c2520-27f7-4185-a08f-749f3520871d is going to be updated. [10152.340786] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.340998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.340998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.341495] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.341495] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.354204] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa1c2520-27f7-4185-a08f-749f3520871d in Status: IN_PROGRESS for 2s [10152.542908] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.542908] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.547333] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10152.547333] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 457c3391-d047-439c-9df9-3b1b715ca405 with status ACTIVE [10152.547333] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.547333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.547333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.547333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.547333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.547333] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.547333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.547333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.547333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.547333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.547333] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.548105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.548105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.548105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.548105] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.548105] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 457c3391-d047-439c-9df9-3b1b715ca405 is going to be updated. [10152.566676] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10152.566676] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.576718] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.577220] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.577395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.577672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.577835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.578016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.578301] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 333e0845-02d8-4c70-8281-e3130037fa8e: rpc.has_security_group_logging(os_id): False [10152.597962] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.598150] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.598221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.598459] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.598664] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.599306] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.599306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.599306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.599306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.599306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.599514] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e is going to be created. [10152.705136] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10152.706534] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10152.706534] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10152.706534] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10152.706534] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10152.724203] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: IN_PROGRESS for 2s [10153.054021] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10153.248675] env[65939]: INFO networking_nsxv3.common.synchronization [None req-4092677d-66b2-4dff-a333-9663c3a0ba8e None None] Enqueued Resource ID: 71fbf69b-e5e4-4da1-8d04-96e18a2b0e59 with Priority: HIGHEST for action port [10153.249096] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71fbf69b-e5e4-4da1-8d04-96e18a2b0e59 with Priority: HIGHEST for action port [10153.252887] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-71fbf69b-e5e4-4da1-8d04-96e18a2b0e59 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10153.253117] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71fbf69b-e5e4-4da1-8d04-96e18a2b0e59" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10153.253188] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71fbf69b-e5e4-4da1-8d04-96e18a2b0e59" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10153.253480] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71fbf69b-e5e4-4da1-8d04-96e18a2b0e59" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10153.253559] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71fbf69b-e5e4-4da1-8d04-96e18a2b0e59',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10153.554952] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10153.555254] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10153.555326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10153.555538] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10153.555629] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10153.555757] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa is going to be created. [10153.584115] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10153.585207] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10153.585207] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10153.585207] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10153.585207] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10153.599291] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: UNINITIALIZED for 2s [10153.755964] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71fbf69b-e5e4-4da1-8d04-96e18a2b0e59 [10153.756844] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10153.756989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10153.757066] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10153.757288] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10153.757954] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10153.758059] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71fbf69b-e5e4-4da1-8d04-96e18a2b0e59 already deleted. [10153.758161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71fbf69b-e5e4-4da1-8d04-96e18a2b0e59" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10154.366844] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa1c2520-27f7-4185-a08f-749f3520871d in Status: SUCCESS [10154.367044] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa1c2520-27f7-4185-a08f-749f3520871d deletion is rescheduled due to dependency. [10154.367165] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10154.742968] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: SUCCESS [10154.743332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10155.611241] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: SUCCESS [10155.611241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10155.611411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10155.611561] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10155.611751] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10155.611863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10155.611923] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10155.612130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10155.612175] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10155.613024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10155.613024] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10155.941390] env[65939]: INFO networking_nsxv3.common.synchronization [req-7f1079f4-5868-43a6-97d8-2c92d35c65a9 req-a5e065db-a734-4847-830d-1386a8f67a27 tempest-ServerDiskConfigTestJSON-1925570613 tempest-ServerDiskConfigTestJSON-1925570613-project-member] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10155.942478] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10155.942478] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10155.942478] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10155.942478] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10155.942795] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10155.942795] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10155.942913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10155.942948] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10155.943925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10155.944040] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10155.944197] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10156.033530] env[65939]: INFO networking_nsxv3.common.synchronization [None req-46458623-27a5-4575-bdbe-8b2d826af719 None None] Enqueued Resource ID: 9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595 with Priority: HIGHEST for action port [10156.034082] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595 with Priority: HIGHEST for action port [10156.034200] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.034319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.034386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.034885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.035060] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10156.115944] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.115944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.115944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.115944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.116269] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.116269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.116269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.116390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.116390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.116467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.116717] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.116805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.117239] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.117239] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.117239] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.117239] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.117436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.117436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.117530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.118074] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.118074] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10156.447858] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.447858] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.447858] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.448061] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.448092] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.448260] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.448373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.448568] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.448682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.448682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.448802] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be updated. [10156.481147] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.481313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.481313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.481825] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.481825] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.491042] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: IN_PROGRESS for 2s [10156.537751] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595 [10156.537914] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.538127] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.538200] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.538880] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.538880] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.538880] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595 already deleted. [10156.538880] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ae9a8cc-dbfa-4f45-b74b-c9704fe4f595" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.623037] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f040ac16-496e-4b1e-b10a-6e1bc87cecaa: rpc.has_security_group_logging(os_id): False [10156.643441] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.643623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.643695] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.644017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.644126] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.644363] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.644469] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.644526] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.645588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.645588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.645588] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.645588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.645588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.645588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.645863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.645971] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.645971] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.646071] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.646185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.646256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.646329] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa is going to be created. [10156.709436] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.709584] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.709654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.709864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.710060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10156.723298] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: IN_PROGRESS for 2s [10156.742707] env[65939]: INFO networking_nsxv3.common.synchronization [None req-63063cf6-05bb-454f-8c52-fdf239d77efb None None] Enqueued Resource ID: 7ff741ac-9afa-471f-ab56-1bc7e559c491 with Priority: HIGHEST for action port [10156.743288] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff741ac-9afa-471f-ab56-1bc7e559c491 with Priority: HIGHEST for action port [10156.743596] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ff741ac-9afa-471f-ab56-1bc7e559c491 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10156.743723] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ff741ac-9afa-471f-ab56-1bc7e559c491" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10156.743791] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ff741ac-9afa-471f-ab56-1bc7e559c491" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10156.744839] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ff741ac-9afa-471f-ab56-1bc7e559c491" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10156.746251] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff741ac-9afa-471f-ab56-1bc7e559c491',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10157.247324] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ff741ac-9afa-471f-ab56-1bc7e559c491 [10157.247535] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10157.247603] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10157.247643] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10157.249030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10157.249030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10157.249030] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ff741ac-9afa-471f-ab56-1bc7e559c491 already deleted. [10157.249030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ff741ac-9afa-471f-ab56-1bc7e559c491" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10157.540415] env[65939]: INFO networking_nsxv3.common.synchronization [req-ac64079a-3171-464a-9928-69203e3370d2 req-be67d5fe-093d-4cb9-a19d-a115652e6576 tempest-DeleteServersAdminTestJSON-1620884639 tempest-DeleteServersAdminTestJSON-1620884639-project-member] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10157.541360] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10157.541858] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10157.542059] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10157.542299] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10157.542551] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10157.543693] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10157.544692] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10157.544778] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10157.545230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10157.545393] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10157.545679] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10157.664458] env[65939]: INFO networking_nsxv3.common.synchronization [None req-874a4e3c-85ca-4345-9115-9553b56ed66e None None] Enqueued Resource ID: 7756a4f8-b9c1-40a9-b483-b659bf50ffee with Priority: HIGHEST for action port [10157.665431] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7756a4f8-b9c1-40a9-b483-b659bf50ffee with Priority: HIGHEST for action port [10157.665556] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-7756a4f8-b9c1-40a9-b483-b659bf50ffee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10157.665686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7756a4f8-b9c1-40a9-b483-b659bf50ffee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10157.665742] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7756a4f8-b9c1-40a9-b483-b659bf50ffee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10157.666023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7756a4f8-b9c1-40a9-b483-b659bf50ffee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10157.666109] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7756a4f8-b9c1-40a9-b483-b659bf50ffee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10158.011389] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.011616] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.011758] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.012488] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.012823] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.013100] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.013212] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.013480] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.013649] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.013889] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10158.014020] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10158.015978] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10158.015978] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10158.015978] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10158.015978] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10158.015978] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10158.024344] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ce9887b8-d002-4ae9-af01-b2c065762a65 None None] Enqueued Resource ID: d9317807-bb82-46a4-ba4b-2ba3fac14090 with Priority: HIGHEST for action port [10158.026850] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9317807-bb82-46a4-ba4b-2ba3fac14090 with Priority: HIGHEST for action port [10158.027742] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9317807-bb82-46a4-ba4b-2ba3fac14090 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.027893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9317807-bb82-46a4-ba4b-2ba3fac14090" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.027962] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9317807-bb82-46a4-ba4b-2ba3fac14090" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.028331] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9317807-bb82-46a4-ba4b-2ba3fac14090" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.028425] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9317807-bb82-46a4-ba4b-2ba3fac14090',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10158.039823] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10158.040019] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10158.040157] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10158.040334] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.040655] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-63123ed0-a702-4cd3-8639-b01a5eb7af99 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.040825] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-63123ed0-a702-4cd3-8639-b01a5eb7af99" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.040940] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-63123ed0-a702-4cd3-8639-b01a5eb7af99" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.041298] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-63123ed0-a702-4cd3-8639-b01a5eb7af99" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.041433] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63123ed0-a702-4cd3-8639-b01a5eb7af99',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10158.049946] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.049946] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.049946] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.050164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.050164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.050621] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.050621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.050621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.050621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.050794] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.050794] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be updated. [10158.083815] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.084121] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.084207] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.084373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.084506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.097902] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: IN_PROGRESS for 2s [10158.170587] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7756a4f8-b9c1-40a9-b483-b659bf50ffee [10158.170659] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.172178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.172250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.172508] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.172612] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.172717] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7756a4f8-b9c1-40a9-b483-b659bf50ffee already deleted. [10158.172805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7756a4f8-b9c1-40a9-b483-b659bf50ffee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.502630] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: SUCCESS [10158.502911] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 deletion is rescheduled due to dependency. [10158.502911] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.530543] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9317807-bb82-46a4-ba4b-2ba3fac14090 [10158.530879] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.531045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.531118] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.531385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.531483] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.531585] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9317807-bb82-46a4-ba4b-2ba3fac14090 already deleted. [10158.531674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9317807-bb82-46a4-ba4b-2ba3fac14090" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.543686] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.543686] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.543686] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.543978] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.544159] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.544332] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 63123ed0-a702-4cd3-8639-b01a5eb7af99 not found, creating... [10158.544962] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.544962] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.544962] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.545183] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.545220] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.545764] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.545764] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.545764] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.546060] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.546060] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.547118] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 63123ed0-a702-4cd3-8639-b01a5eb7af99 is going to be created. [10158.568088] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.568270] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.568391] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.568978] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.568978] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.569668] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-63123ed0-a702-4cd3-8639-b01a5eb7af99" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.780836] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: SUCCESS [10158.781110] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10158.949073] env[65939]: INFO networking_nsxv3.common.synchronization [None req-d975f853-4230-4532-b3e3-2324f388285b None None] Enqueued Resource ID: 75664d31-fd08-4f1a-a28d-534a20d457c2 with Priority: HIGHEST for action port [10158.949073] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75664d31-fd08-4f1a-a28d-534a20d457c2 with Priority: HIGHEST for action port [10158.949593] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-75664d31-fd08-4f1a-a28d-534a20d457c2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10158.949730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75664d31-fd08-4f1a-a28d-534a20d457c2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10158.949782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75664d31-fd08-4f1a-a28d-534a20d457c2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10158.950065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75664d31-fd08-4f1a-a28d-534a20d457c2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10158.950145] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75664d31-fd08-4f1a-a28d-534a20d457c2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10159.208897] env[65939]: INFO networking_nsxv3.common.synchronization [req-adc508de-87c8-4d5b-9525-57541a912b37 req-72e9e9e2-f75a-4a80-8088-11cd24db1978 tempest-SecurityGroupRulesTestJSON-1313565084 tempest-SecurityGroupRulesTestJSON-1313565084-project-member] Enqueued Resource ID: 332fe8dd-07b9-49df-9224-adc5409c6e74 with Priority: HIGHEST for action security_group_rules [10159.211830] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332fe8dd-07b9-49df-9224-adc5409c6e74 with Priority: HIGHEST for action security_group_rules [10159.211830] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-332fe8dd-07b9-49df-9224-adc5409c6e74 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.211830] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-332fe8dd-07b9-49df-9224-adc5409c6e74" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.211830] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-332fe8dd-07b9-49df-9224-adc5409c6e74" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10159.211830] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-332fe8dd-07b9-49df-9224-adc5409c6e74" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10159.211830] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('332fe8dd-07b9-49df-9224-adc5409c6e74',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10159.334352] env[65939]: INFO networking_nsxv3.common.synchronization [req-ac64079a-3171-464a-9928-69203e3370d2 req-f2ac24f6-bc5d-4037-95de-840a21b8da89 service nova] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_rules [10159.334534] env[65939]: INFO networking_nsxv3.common.synchronization [req-ac64079a-3171-464a-9928-69203e3370d2 req-f2ac24f6-bc5d-4037-95de-840a21b8da89 service nova] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10159.334668] env[65939]: INFO networking_nsxv3.common.synchronization [req-ac64079a-3171-464a-9928-69203e3370d2 req-f2ac24f6-bc5d-4037-95de-840a21b8da89 service nova] Enqueued Resource ID: 63123ed0-a702-4cd3-8639-b01a5eb7af99 with Priority: HIGHEST for action port [10159.335251] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_rules [10159.335385] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10159.335512] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63123ed0-a702-4cd3-8639-b01a5eb7af99 with Priority: HIGHEST for action port [10159.335902] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.336045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.336116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10159.336312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10159.336394] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10159.337317] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.337413] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.337639] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-63123ed0-a702-4cd3-8639-b01a5eb7af99 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.337807] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63123ed0-a702-4cd3-8639-b01a5eb7af99" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.337852] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63123ed0-a702-4cd3-8639-b01a5eb7af99" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10159.338067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63123ed0-a702-4cd3-8639-b01a5eb7af99" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10159.338173] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63123ed0-a702-4cd3-8639-b01a5eb7af99',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10159.455748] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75664d31-fd08-4f1a-a28d-534a20d457c2 [10159.455748] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.455748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.455748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10159.455748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10159.455748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10159.455748] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75664d31-fd08-4f1a-a28d-534a20d457c2 already deleted. [10159.455748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75664d31-fd08-4f1a-a28d-534a20d457c2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10159.733262] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.733262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.733537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10159.733537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10159.733537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10159.733537] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 332fe8dd-07b9-49df-9224-adc5409c6e74 already deleted. [10159.733537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-332fe8dd-07b9-49df-9224-adc5409c6e74" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10159.842515] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.842661] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.842871] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63123ed0-a702-4cd3-8639-b01a5eb7af99 with status ACTIVE [10159.843238] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.843238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.843356] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10159.843894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10159.843894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10159.843894] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.843894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.843894] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10159.844130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10159.844130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10159.844314] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.844403] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.844480] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10159.845319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10159.845319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10159.845319] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63123ed0-a702-4cd3-8639-b01a5eb7af99 is going to be updated. [10159.870271] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10159.870271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10159.870271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10159.870271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10159.870271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10159.870271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63123ed0-a702-4cd3-8639-b01a5eb7af99" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10160.117966] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: SUCCESS [10160.118163] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 deletion is rescheduled due to dependency. [10160.118276] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10160.118443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10160.118654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10160.118832] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10160.118947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10160.119031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10160.119172] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10160.119249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10160.119336] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10160.174770] env[65939]: INFO networking_nsxv3.common.synchronization [None req-134ead89-f0bd-4ed6-b5a4-f377c66ef5f5 None None] Enqueued Resource ID: 0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287 with Priority: HIGHEST for action port [10160.176837] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287 with Priority: HIGHEST for action port [10160.180213] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10160.180213] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10160.180213] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10160.185102] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10160.185102] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10160.320720] env[65939]: INFO networking_nsxv3.common.synchronization [None req-1525b128-ca68-42a6-afeb-e79f68a19603 tempest-ServersTestBootFromVolume-647247302 tempest-ServersTestBootFromVolume-647247302-project-member] Enqueued Resource ID: 1dc890d1-f399-4bc3-968a-2cfeed995fd6 with Priority: HIGHEST for action security_group_rules [10160.322239] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dc890d1-f399-4bc3-968a-2cfeed995fd6 with Priority: HIGHEST for action security_group_rules [10160.322239] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10160.322239] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10160.322239] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10160.322454] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10160.322559] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dc890d1-f399-4bc3-968a-2cfeed995fd6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10160.624794] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10160.684884] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287 [10160.686355] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10160.686577] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10160.686657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10160.686879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10160.687026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10160.687069] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287 already deleted. [10160.687149] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ca4fcc0-1e85-4dc9-9cee-1a8e664d7287" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10160.738387] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ead0b85b-23cc-464e-b5e4-6e6aba9b61b5 tempest-ServersTestBootFromVolume-647247302 tempest-ServersTestBootFromVolume-647247302-project-member] Enqueued Resource ID: 1dc890d1-f399-4bc3-968a-2cfeed995fd6 with Priority: HIGHEST for action security_group_rules [10160.738387] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dc890d1-f399-4bc3-968a-2cfeed995fd6 with Priority: HIGHEST for action security_group_rules [10160.739106] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10160.739106] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10160.844182] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10160.844182] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10160.844182] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10160.844335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10160.844335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10160.844437] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dc890d1-f399-4bc3-968a-2cfeed995fd6 already deleted. [10160.844931] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10160.844931] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10160.844931] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10160.844931] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1dc890d1-f399-4bc3-968a-2cfeed995fd6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10161.128319] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10161.364092] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10161.364372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10161.364372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10161.364520] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10161.364605] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10161.364780] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1dc890d1-f399-4bc3-968a-2cfeed995fd6 already deleted. [10161.364845] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1dc890d1-f399-4bc3-968a-2cfeed995fd6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10161.589255] env[65939]: INFO networking_nsxv3.common.synchronization [None req-086dc53a-d811-469b-ab04-4f381b1da596 None None] Enqueued Resource ID: c2223c55-1f43-4bd3-a0ac-180394ed5fd2 with Priority: HIGHEST for action port [10161.589896] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2223c55-1f43-4bd3-a0ac-180394ed5fd2 with Priority: HIGHEST for action port [10161.591102] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2223c55-1f43-4bd3-a0ac-180394ed5fd2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10161.591102] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2223c55-1f43-4bd3-a0ac-180394ed5fd2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10161.591102] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2223c55-1f43-4bd3-a0ac-180394ed5fd2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10161.591492] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2223c55-1f43-4bd3-a0ac-180394ed5fd2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10161.591492] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2223c55-1f43-4bd3-a0ac-180394ed5fd2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10161.631612] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10161.631612] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10161.633966] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10161.635610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10161.635751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10161.635893] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be updated. [10161.673265] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10161.675654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10161.675654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10161.675654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10161.675654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10161.683537] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: IN_PROGRESS for 2s [10162.094516] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2223c55-1f43-4bd3-a0ac-180394ed5fd2 [10162.094769] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10162.094890] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10162.094955] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10162.095243] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10162.095322] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10162.095404] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2223c55-1f43-4bd3-a0ac-180394ed5fd2 already deleted. [10162.095513] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2223c55-1f43-4bd3-a0ac-180394ed5fd2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10162.258385] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b45d86c3-a6b8-41a7-823e-4b4aa24c9f30 tempest-ServerActionsTestOtherA-1770217961 tempest-ServerActionsTestOtherA-1770217961-project-member] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_rules [10162.258385] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_rules [10162.258385] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10162.258385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10162.258385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10162.260438] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10162.260617] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10162.394504] env[65939]: INFO networking_nsxv3.common.synchronization [None req-f0ceee93-e5c7-4c2e-b023-8d7756e6546a tempest-ServerActionsTestOtherA-1770217961 tempest-ServerActionsTestOtherA-1770217961-project-member] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_rules [10162.395404] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_rules [10162.395847] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10162.395994] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10162.673195] env[65939]: INFO networking_nsxv3.common.synchronization [req-20cc024f-cb74-4f70-909e-985eb7186d7d req-cd484c73-99ac-4ad7-8790-d39850190bbe tempest-ServerExternalEventsTest-736562566 tempest-ServerExternalEventsTest-736562566-project-member] Enqueued Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGHEST for action security_group_members [10162.674189] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGHEST for action security_group_members [10162.674489] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10162.674698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10162.674791] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10162.675201] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10162.675412] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10162.675603] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10162.675697] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10162.675973] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10162.676164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10162.676345] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10162.789270] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10162.789270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10162.789270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10162.789270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10162.789270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10162.789270] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 already deleted. [10162.789270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10162.789270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10162.789270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10162.789270] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10163.179410] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.179757] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.179807] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.180146] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.180393] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.180683] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.180879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.180935] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.181113] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.181221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.181318] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac3248a-183f-4532-817e-246814962f51 already deleted. [10163.181402] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.258421] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.259122] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.259122] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.259122] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.259387] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.259540] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.259650] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.260079] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.260321] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.260864] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10163.260934] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10163.261121] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10163.261244] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10163.261755] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10163.261755] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10163.261755] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10163.282876] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10163.283150] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10163.283349] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10163.283588] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-221" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.283964] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-b30da619-5394-4d7f-919e-0c82044cb653 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.284338] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-b30da619-5394-4d7f-919e-0c82044cb653" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.284683] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-b30da619-5394-4d7f-919e-0c82044cb653" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.285198] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-b30da619-5394-4d7f-919e-0c82044cb653" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.285430] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b30da619-5394-4d7f-919e-0c82044cb653',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10163.315185] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.315395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.315395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.316120] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.316120] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.316120] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 already deleted. [10163.316120] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.695881] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: SUCCESS [10163.696153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.696412] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.696717] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.696975] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.697132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.697314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.697365] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.699779] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.699779] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.699779] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10163.788432] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.788681] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.788835] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.789125] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.789275] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.789428] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port b30da619-5394-4d7f-919e-0c82044cb653 not found, creating... [10163.789661] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.789813] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.789922] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.790242] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.790288] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.790582] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.790698] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.790794] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.791051] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.791207] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.791347] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: b30da619-5394-4d7f-919e-0c82044cb653 is going to be created. [10163.816260] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10163.816476] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10163.816587] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10163.816861] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10163.817097] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10163.817320] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-b30da619-5394-4d7f-919e-0c82044cb653" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.202387] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.202671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.202671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.202671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.202848] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.202951] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.203917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.204147] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.204247] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.204343] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.204494] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.204592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.204656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.205729] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.205885] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.205985] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.206061] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.206234] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.206313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.206397] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.206489] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10164.421933] env[65939]: INFO networking_nsxv3.common.synchronization [None req-007e3cf7-99ac-4067-b8fa-e68e4f9653ed tempest-AttachVolumeTestJSON-692976414 tempest-AttachVolumeTestJSON-692976414-project-member] Enqueued Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_rules [10164.422552] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_rules [10164.422991] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.423174] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.423282] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.423562] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.423699] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10164.537098] env[65939]: INFO networking_nsxv3.common.synchronization [req-20cc024f-cb74-4f70-909e-985eb7186d7d req-aa98a68c-1bc7-4bc6-9a6d-1b21b1f82ed9 service nova] Enqueued Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGHEST for action security_group_rules [10164.537180] env[65939]: INFO networking_nsxv3.common.synchronization [req-20cc024f-cb74-4f70-909e-985eb7186d7d req-aa98a68c-1bc7-4bc6-9a6d-1b21b1f82ed9 service nova] Enqueued Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGHEST for action security_group_members [10164.537341] env[65939]: INFO networking_nsxv3.common.synchronization [req-20cc024f-cb74-4f70-909e-985eb7186d7d req-aa98a68c-1bc7-4bc6-9a6d-1b21b1f82ed9 service nova] Enqueued Resource ID: b30da619-5394-4d7f-919e-0c82044cb653 with Priority: HIGHEST for action port [10164.537968] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGHEST for action security_group_rules [10164.538780] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGHEST for action security_group_members [10164.538780] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b30da619-5394-4d7f-919e-0c82044cb653 with Priority: HIGHEST for action port [10164.538918] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.539014] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.539138] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.539418] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.539673] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10164.541113] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.541203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.541302] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.541558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.541724] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.541895] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.541895] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.542050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.542156] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.542286] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10164.543973] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-b30da619-5394-4d7f-919e-0c82044cb653 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.544199] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b30da619-5394-4d7f-919e-0c82044cb653" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.544451] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b30da619-5394-4d7f-919e-0c82044cb653" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.544451] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b30da619-5394-4d7f-919e-0c82044cb653" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.544556] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b30da619-5394-4d7f-919e-0c82044cb653',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10164.709941] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed701299-54b2-4fb1-b7d6-f2f2b3925210: rpc.has_security_group_logging(os_id): False [10164.733767] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.733998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.733998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.737287] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.737446] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.738526] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.738728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.738800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.739013] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.739112] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.739346] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.739453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.739516] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.739669] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.739748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.739954] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.740062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.740101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.740233] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.740309] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.740409] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be updated. [10164.822167] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.822270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.822343] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.822549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.822711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.839171] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: IN_PROGRESS for 2s [10164.877087] env[65939]: INFO networking_nsxv3.common.synchronization [None req-40f7da1a-7bff-4719-8c3b-705251fd4cb2 tempest-AttachVolumeTestJSON-692976414 tempest-AttachVolumeTestJSON-692976414-project-member] Enqueued Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_rules [10164.879506] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_rules [10164.879876] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.879990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.950476] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10164.950832] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10164.950964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.951413] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.951559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.951691] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee already deleted. [10164.951870] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10164.952116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10164.952597] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10164.952985] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10165.043886] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10165.043886] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10165.045117] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10165.046627] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b30da619-5394-4d7f-919e-0c82044cb653 with status ACTIVE [10165.048682] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10165.048682] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10165.048682] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10165.048682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10165.049284] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10165.049284] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10165.049284] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b30da619-5394-4d7f-919e-0c82044cb653 is going to be updated. [10165.083176] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10165.083361] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10165.083415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10165.083610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10165.083745] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10165.083903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b30da619-5394-4d7f-919e-0c82044cb653" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10165.483618] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10165.483992] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10165.483992] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10165.484201] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10165.484326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10165.484448] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee already deleted. [10165.484537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10165.554034] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10166.060125] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10166.060329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10166.060401] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10166.060686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10166.060793] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10166.060898] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac3248a-183f-4532-817e-246814962f51 is going to be created. [10166.088303] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10166.088479] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10166.088519] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10166.088907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10166.088996] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10166.100974] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac3248a-183f-4532-817e-246814962f51 in Status: UNINITIALIZED for 2s [10166.132559] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:39 completed [10166.132883] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:40 started [10166.493616] env[65939]: INFO networking_nsxv3.common.synchronization [None req-f7bf2548-0bb9-4ff6-998d-de8779e40f43 None None] Enqueued Resource ID: 69dbb5c8-e400-4202-8c63-f7765a249d74 with Priority: HIGHEST for action port [10166.494221] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69dbb5c8-e400-4202-8c63-f7765a249d74 with Priority: HIGHEST for action port [10166.494526] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-69dbb5c8-e400-4202-8c63-f7765a249d74 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10166.494650] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69dbb5c8-e400-4202-8c63-f7765a249d74" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10166.494719] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69dbb5c8-e400-4202-8c63-f7765a249d74" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10166.494988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69dbb5c8-e400-4202-8c63-f7765a249d74" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10166.495417] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69dbb5c8-e400-4202-8c63-f7765a249d74',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10166.855731] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: SUCCESS [10166.855731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10167.000544] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69dbb5c8-e400-4202-8c63-f7765a249d74 [10167.000544] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10167.000544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10167.000544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10167.000544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10167.000544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10167.000544] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69dbb5c8-e400-4202-8c63-f7765a249d74 already deleted. [10167.000544] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69dbb5c8-e400-4202-8c63-f7765a249d74" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10168.115618] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac3248a-183f-4532-817e-246814962f51 in Status: SUCCESS [10168.116625] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10168.116625] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10168.116625] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10168.116799] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10168.116857] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10168.116968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10168.117302] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10168.117461] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10168.117711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10168.117920] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10168.621296] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10168.621526] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10168.621569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10168.621778] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10168.621957] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10168.622114] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10168.622209] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10168.622344] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10168.622439] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10168.622523] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10168.622674] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10168.622797] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10168.622855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10168.622997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10168.623150] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10168.623240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10168.623297] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10168.623432] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10168.623508] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10168.623587] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10168.623744] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10168.979239] env[65939]: INFO networking_nsxv3.common.synchronization [req-9dc9b7e6-fe01-48f6-a9fd-cf539e9f692a req-d0356b3f-7253-4e3c-9281-578db4c41dfd tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_members [10168.979894] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_members [10168.980258] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-152e138c-a16f-4ab1-ae1d-27177515f5d0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10168.980379] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10168.980441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10168.982024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10168.982024] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10168.982024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10168.982024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10168.982024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10168.982024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10168.982024] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10169.129476] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ac3248a-183f-4532-817e-246814962f51: rpc.has_security_group_logging(os_id): False [10169.151835] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10169.151835] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10169.151835] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.151835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10169.152380] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.152380] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.152380] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.155281] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.155386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10169.155490] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac3248a-183f-4532-817e-246814962f51 is going to be created. [10169.244864] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.244864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.244864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.244864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.244864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10169.259947] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac3248a-183f-4532-817e-246814962f51 in Status: IN_PROGRESS for 2s [10169.484490] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.484490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.484490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.484490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.484722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10169.484827] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.484880] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.484933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.485091] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.485162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10169.485248] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 already deleted. [10169.485336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10169.581138] env[65939]: INFO networking_nsxv3.common.synchronization [None req-51592093-f1e0-45dc-8bfc-964bba73c7df None None] Enqueued Resource ID: b15b5ccf-2cbd-4533-8283-8279b637a919 with Priority: HIGHEST for action port [10169.582035] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b15b5ccf-2cbd-4533-8283-8279b637a919 with Priority: HIGHEST for action port [10169.583097] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-b15b5ccf-2cbd-4533-8283-8279b637a919 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.583706] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b15b5ccf-2cbd-4533-8283-8279b637a919" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.583706] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b15b5ccf-2cbd-4533-8283-8279b637a919" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.583706] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b15b5ccf-2cbd-4533-8283-8279b637a919" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.583706] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b15b5ccf-2cbd-4533-8283-8279b637a919',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10169.988243] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.988243] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-509" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.988388] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-509" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.988688] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-509" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.989234] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10169.989234] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10169.989349] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10169.989571] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10169.989734] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10169.990076] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10169.990135] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10169.990242] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10169.990345] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10169.990474] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10169.990577] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10169.990889] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10170.018357] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10170.018525] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10170.018648] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10170.019026] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-509" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.019341] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-1658ed36-e19d-49ae-9121-9e5bbbb05db4 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10170.019522] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-1658ed36-e19d-49ae-9121-9e5bbbb05db4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10170.019650] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-1658ed36-e19d-49ae-9121-9e5bbbb05db4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10170.020026] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-1658ed36-e19d-49ae-9121-9e5bbbb05db4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10170.020465] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1658ed36-e19d-49ae-9121-9e5bbbb05db4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10170.087811] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b15b5ccf-2cbd-4533-8283-8279b637a919 [10170.088098] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10170.088241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10170.088241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10170.088598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10170.088598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.088598] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b15b5ccf-2cbd-4533-8283-8279b637a919 already deleted. [10170.088764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b15b5ccf-2cbd-4533-8283-8279b637a919" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.153998] env[65939]: INFO networking_nsxv3.common.synchronization [None req-327864fe-e23f-4e00-982b-098611d1f6fb tempest-MigrationsAdminTest-1348166828 tempest-MigrationsAdminTest-1348166828-project-member] Enqueued Resource ID: 7f47a844-08ec-42da-9f6c-94057320fb5d with Priority: HIGHEST for action security_group_rules [10170.154822] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f47a844-08ec-42da-9f6c-94057320fb5d with Priority: HIGHEST for action security_group_rules [10170.155585] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f47a844-08ec-42da-9f6c-94057320fb5d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10170.155585] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f47a844-08ec-42da-9f6c-94057320fb5d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10170.155585] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f47a844-08ec-42da-9f6c-94057320fb5d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10170.156050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f47a844-08ec-42da-9f6c-94057320fb5d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10170.156161] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f47a844-08ec-42da-9f6c-94057320fb5d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10170.523718] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10170.523870] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10170.527023] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10170.527023] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10170.527023] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.527023] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 1658ed36-e19d-49ae-9121-9e5bbbb05db4 not found, creating... [10170.527023] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10170.527023] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10170.527023] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10170.527023] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10170.527023] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.527023] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10170.527784] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10170.527784] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10170.527784] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10170.527784] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.527784] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 1658ed36-e19d-49ae-9121-9e5bbbb05db4 is going to be created. [10170.550113] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10170.550319] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10170.550433] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10170.550701] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10170.550916] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.551141] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-1658ed36-e19d-49ae-9121-9e5bbbb05db4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.678269] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10170.678269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10170.678269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10170.678269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10170.678269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.678269] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f47a844-08ec-42da-9f6c-94057320fb5d already deleted. [10170.678269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f47a844-08ec-42da-9f6c-94057320fb5d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10170.878604] env[65939]: INFO networking_nsxv3.common.synchronization [None req-71d44742-f70f-4e23-9f6f-60b110546fd0 tempest-MigrationsAdminTest-1348166828 tempest-MigrationsAdminTest-1348166828-project-member] Enqueued Resource ID: 7f47a844-08ec-42da-9f6c-94057320fb5d with Priority: HIGHEST for action security_group_rules [10170.880335] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f47a844-08ec-42da-9f6c-94057320fb5d with Priority: HIGHEST for action security_group_rules [10170.880717] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f47a844-08ec-42da-9f6c-94057320fb5d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10170.880851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f47a844-08ec-42da-9f6c-94057320fb5d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10170.880921] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f47a844-08ec-42da-9f6c-94057320fb5d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10170.881138] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f47a844-08ec-42da-9f6c-94057320fb5d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10170.881220] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f47a844-08ec-42da-9f6c-94057320fb5d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10171.254069] env[65939]: INFO networking_nsxv3.common.synchronization [req-9dc9b7e6-fe01-48f6-a9fd-cf539e9f692a req-8d49c62b-ec9c-4c4a-bd66-95bf3ab5b021 service nova] Enqueued Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_rules [10171.254366] env[65939]: INFO networking_nsxv3.common.synchronization [req-9dc9b7e6-fe01-48f6-a9fd-cf539e9f692a req-8d49c62b-ec9c-4c4a-bd66-95bf3ab5b021 service nova] Enqueued Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_members [10171.254401] env[65939]: INFO networking_nsxv3.common.synchronization [req-9dc9b7e6-fe01-48f6-a9fd-cf539e9f692a req-8d49c62b-ec9c-4c4a-bd66-95bf3ab5b021 service nova] Enqueued Resource ID: 1658ed36-e19d-49ae-9121-9e5bbbb05db4 with Priority: HIGHEST for action port [10171.254943] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_rules [10171.255114] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_members [10171.255194] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1658ed36-e19d-49ae-9121-9e5bbbb05db4 with Priority: HIGHEST for action port [10171.255475] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-152e138c-a16f-4ab1-ae1d-27177515f5d0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.255606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.255682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10171.255858] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10171.255937] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10171.257068] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-152e138c-a16f-4ab1-ae1d-27177515f5d0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.257298] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.257298] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10171.257429] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10171.257643] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.257740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.257740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10171.257971] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10171.257971] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10171.258099] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10171.259042] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-1658ed36-e19d-49ae-9121-9e5bbbb05db4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.259146] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1658ed36-e19d-49ae-9121-9e5bbbb05db4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.260098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1658ed36-e19d-49ae-9121-9e5bbbb05db4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10171.260098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1658ed36-e19d-49ae-9121-9e5bbbb05db4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10171.260098] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1658ed36-e19d-49ae-9121-9e5bbbb05db4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10171.273915] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac3248a-183f-4532-817e-246814962f51 in Status: SUCCESS [10171.274154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10171.402683] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.402841] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.402903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10171.403127] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10171.403218] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10171.403319] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f47a844-08ec-42da-9f6c-94057320fb5d already deleted. [10171.403420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f47a844-08ec-42da-9f6c-94057320fb5d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10171.761469] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-152e138c-a16f-4ab1-ae1d-27177515f5d0 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.761641] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.766092] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10171.766092] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1658ed36-e19d-49ae-9121-9e5bbbb05db4 with status ACTIVE [10171.766533] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.766533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.766533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10171.767602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10171.767602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10171.767602] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.767602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.767602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10171.767602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10171.768131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10171.768546] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.768546] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.768546] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10171.768718] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10171.768751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10171.768869] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1658ed36-e19d-49ae-9121-9e5bbbb05db4 is going to be updated. [10171.796048] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10171.796048] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10171.796208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10171.796737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10171.796989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10171.797510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1658ed36-e19d-49ae-9121-9e5bbbb05db4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10172.060012] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10172.060012] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10172.060012] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10172.060012] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10172.060012] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10172.273235] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10172.561624] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10172.776041] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10172.776041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10172.776041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10172.776429] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10172.776429] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10172.776429] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 is going to be created. [10172.813789] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10172.813920] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10172.814023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10172.814304] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10172.814489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10172.826527] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 in Status: UNINITIALIZED for 2s [10173.065266] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10173.381885] env[65939]: INFO networking_nsxv3.common.synchronization [req-ff60b05e-23fc-4614-824c-a94b04e11716 req-146c21ff-32b8-4bc8-8246-a5756ee40dbf tempest-SecurityGroupRulesTestJSON-1313565084 tempest-SecurityGroupRulesTestJSON-1313565084-project-member] Enqueued Resource ID: 96a602a4-ae73-4591-8541-3166c80d2100 with Priority: HIGHEST for action security_group_rules [10173.382487] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a602a4-ae73-4591-8541-3166c80d2100 with Priority: HIGHEST for action security_group_rules [10173.383133] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96a602a4-ae73-4591-8541-3166c80d2100 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10173.383133] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96a602a4-ae73-4591-8541-3166c80d2100" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10173.383133] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96a602a4-ae73-4591-8541-3166c80d2100" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10173.383502] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96a602a4-ae73-4591-8541-3166c80d2100" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10173.383858] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96a602a4-ae73-4591-8541-3166c80d2100',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10173.567479] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [10173.568583] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [10173.904086] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10173.904303] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10173.904400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10173.904779] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10173.904851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10173.904965] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96a602a4-ae73-4591-8541-3166c80d2100 already deleted. [10173.905109] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96a602a4-ae73-4591-8541-3166c80d2100" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10173.983374] env[65939]: INFO networking_nsxv3.common.synchronization [req-f82dcf98-1bca-4392-a6b8-a6a3aa227677 req-8bca6325-f16b-4c52-a854-5fb9e7deb63c tempest-ServerActionsV293TestJSON-1024262967 tempest-ServerActionsV293TestJSON-1024262967-project-member] Enqueued Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_members [10173.983374] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_members [10173.983881] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0448a07-8b92-443f-84c4-39c4126ca3d2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10173.983999] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10173.984078] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10173.984336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10173.984645] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10173.984758] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10173.984826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10173.984989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10173.985114] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10173.985213] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.431283] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.431283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.431283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.431283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.449307] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [10174.450857] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.452463] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [10174.455575] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-401 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.455839] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-401" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.456034] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-401" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.456355] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-401" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.456717] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.456875] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.457091] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.457370] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.457564] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.457836] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10174.458016] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10174.458157] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10174.458292] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10174.458713] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10174.458713] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10174.458713] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10174.477796] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10174.478587] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10174.478587] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10174.478587] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-401" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.478777] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-26c1ddc7-cad1-4102-857d-50b27cc94a49 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.478777] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-26c1ddc7-cad1-4102-857d-50b27cc94a49" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.478900] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-26c1ddc7-cad1-4102-857d-50b27cc94a49" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.479210] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-26c1ddc7-cad1-4102-857d-50b27cc94a49" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.479353] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26c1ddc7-cad1-4102-857d-50b27cc94a49',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.481779] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.481943] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.482016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.482197] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.486517] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.486837] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [10174.486945] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10174.487138] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [10174.488583] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.488737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.488823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.489062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.489218] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.489365] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.489460] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.489819] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.489819] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.489885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.490035] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 already deleted. [10174.490176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.523099] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.523099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.523099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.523099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.523667] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.523768] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [10174.573516] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.573696] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.573767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.573988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.574174] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.574350] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [10174.629053] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.629285] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.629285] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.629805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.629805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.629989] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:14. [10174.629989] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fa1c2520-27f7-4185-a08f-749f3520871d', '0bc9971a-4944-4376-bed1-dab9f3b05345', '7bb3e04f-6e66-47c4-8e1c-e6c56d139b32', 'f040ac16-496e-4b1e-b10a-6e1bc87cecaa', '4415b353-eee7-421d-a222-35308d9d05b7', '333e0845-02d8-4c70-8281-e3130037fa8e', '0c59cdfc-cd95-45c8-bf65-8334d2d2cce6', '4361c451-dad4-41c4-b71f-bbfd50f8ea0d', 'b696069c-81a6-4243-95fa-f24b214bded3', '62f0f078-b1aa-4721-8b07-eb126a6fb449', '2ac3248a-183f-4532-817e-246814962f51', '95cc14d0-8b63-4ace-a5e1-f800e80faf90', 'ed701299-54b2-4fb1-b7d6-f2f2b3925210', '99711482-089a-4472-8ac3-fb1d995ba6dd'} {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10174.629989] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [10174.654454] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.654701] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.654701] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.655341] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.655341] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.655341] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [10174.655341] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10174.655341] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [10174.707569] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.707834] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.707834] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.708090] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.708510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.708715] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [10174.708793] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10174.708900] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [10174.709071] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [10174.709188] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 14/14 resources of Type:Security Group Rules [10174.709304] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGH for action security_group_rules [10174.709408] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGH for action security_group_rules [10174.709508] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGH for action security_group_rules [10174.709575] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGH for action security_group_rules [10174.709639] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGH for action security_group_rules [10174.709701] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGH for action security_group_rules [10174.709816] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGH for action security_group_rules [10174.709915] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGH for action security_group_rules [10174.709997] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGH for action security_group_rules [10174.710095] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGH for action security_group_rules [10174.710174] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGH for action security_group_rules [10174.710376] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGH for action security_group_rules [10174.710471] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGH for action security_group_rules [10174.710549] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGH for action security_group_rules [10174.710630] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [10174.710699] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [10174.710926] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.711088] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.711183] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.711517] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.711653] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.711903] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.712040] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.712115] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.712294] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.712386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.712607] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.712714] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.712785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.712988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.713104] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.713298] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.713398] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.713456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.713602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.713674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.713855] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.713955] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.714034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.714186] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.714278] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.714488] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.714598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.714642] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.714766] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.714849] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.715049] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.715153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.715225] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.715362] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.715472] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.715642] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.715755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.715823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.715972] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.716065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.716262] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.716362] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.716430] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.716576] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.716657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.716853] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.716953] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.717028] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.717216] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.717280] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.717459] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.717548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.717619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.717765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.717845] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.718028] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.718115] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.718186] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.718326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.718399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.718707] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.718855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.718933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.719109] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.719185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.719366] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.719455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.719531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.719665] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.719745] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.719909] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.720000] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.720119] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.720193] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.720279] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.720460] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.720549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.720607] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.720767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.720822] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.721032] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.721110] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.721155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.721304] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.721385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.721551] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.721629] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.721693] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.721864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.721939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.722070] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.722162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.722216] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.722359] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.722432] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.722606] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.722695] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.722746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.722918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.723042] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.723308] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.723436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.723496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.723653] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.723721] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.723901] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.724034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.724109] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.724232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.724298] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.724484] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.724569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.724726] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.724761] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.724833] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.725047] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.725120] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.725183] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.725351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.725422] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.725587] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.725715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.725774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.725909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.725993] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.726266] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.726374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.726429] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.726586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.726663] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.726844] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.726944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.727025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.727168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.727260] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.727349] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [10174.727406] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [10174.727469] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [10174.786296] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.786296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.786296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.786296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.786296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.786569] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [10174.836948] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 in Status: SUCCESS [10174.837182] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.837419] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.837682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.837923] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.838058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.838127] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.838343] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.838432] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.838520] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.838611] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.841672] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.841820] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.841861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.842052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.842247] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.858968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.877783] env[65939]: INFO networking_nsxv3.common.synchronization [None req-a98884b6-e300-478b-9ef9-b2e4950f2b5a None None] Enqueued Resource ID: df91a356-7cab-4b61-aba1-f6e09f742433 with Priority: HIGHEST for action port [10174.878646] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df91a356-7cab-4b61-aba1-f6e09f742433 with Priority: HIGHEST for action port [10174.878646] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGH for action security_group_rules [10174.878646] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGH for action security_group_rules [10174.878797] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGH for action security_group_rules [10174.878797] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGH for action security_group_rules [10174.878912] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGH for action security_group_rules [10174.879014] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGH for action security_group_rules [10174.879088] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGH for action security_group_rules [10174.879192] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGH for action security_group_rules [10174.879299] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGH for action security_group_rules [10174.879361] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGH for action security_group_rules [10174.879448] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGH for action security_group_rules [10174.879551] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGH for action security_group_rules [10174.879609] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGH for action security_group_rules [10174.880124] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGH for action security_group_rules [10174.880430] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-df91a356-7cab-4b61-aba1-f6e09f742433 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.880582] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df91a356-7cab-4b61-aba1-f6e09f742433" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.880853] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df91a356-7cab-4b61-aba1-f6e09f742433" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.880899] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df91a356-7cab-4b61-aba1-f6e09f742433" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.880984] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df91a356-7cab-4b61-aba1-f6e09f742433',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.881832] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa1c2520-27f7-4185-a08f-749f3520871d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.881947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.882027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.882200] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.882280] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.882985] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.883143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.883202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.883305] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.883417] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.884984] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.884984] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.884984] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.885193] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.885246] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.886354] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99711482-089a-4472-8ac3-fb1d995ba6dd taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.886709] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.886709] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.886709] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.886969] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.889136] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.889136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.889136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.889136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.889136] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.889478] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.889478] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.889591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.889728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.889728] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.890569] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.890676] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.890743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.890915] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.890994] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.892023] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.892168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.892244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.892334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.892403] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.892629] env[65939]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [10174.893378] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b696069c-81a6-4243-95fa-f24b214bded3 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.893466] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.893508] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.893722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.893722] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.894569] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.895138] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.895138] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.895138] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.895138] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.895990] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.896122] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.896261] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.896585] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.896585] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.897206] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.897340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.897439] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.898753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.898753] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.898753] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.898753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.898753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.898753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.898961] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.899717] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.899811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.899891] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.900028] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.900096] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10174.991258] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.991571] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.991684] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.991950] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.992261] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.992351] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 26c1ddc7-cad1-4102-857d-50b27cc94a49 not found, creating... [10174.992583] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.992741] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.992856] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.993147] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.993315] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.993756] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10174.994153] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10174.994316] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10174.994580] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10174.994761] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10174.994932] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 26c1ddc7-cad1-4102-857d-50b27cc94a49 is going to be created. [10175.018753] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.019058] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.019214] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.020089] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.020089] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.020089] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-26c1ddc7-cad1-4102-857d-50b27cc94a49" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.344402] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.402928] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df91a356-7cab-4b61-aba1-f6e09f742433 [10175.403194] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.403300] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.403367] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.403566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.403653] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.403752] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df91a356-7cab-4b61-aba1-f6e09f742433 already deleted. [10175.403859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df91a356-7cab-4b61-aba1-f6e09f742433" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.404133] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.404256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.404348] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.404507] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.404646] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.404734] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.404795] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.404939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.405014] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.405095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.405183] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.428368] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.428532] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.428579] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.428823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.430943] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.431114] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.431208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.431326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.431659] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.431659] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.431659] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.431789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.431818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.431907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.431990] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.432888] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.432994] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.433064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.433214] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.433348] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.433461] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.433495] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.433623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.433697] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.433775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.434233] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.437605] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.437761] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.437817] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.438229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.438229] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.438324] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.438359] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.438482] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.438572] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.438616] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.438698] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.439811] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.439811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.439811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.439985] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.440036] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.440134] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.440197] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.440336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.440411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.440491] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.440569] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.441348] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.441540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.441540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.441666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.441848] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.441940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.442016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.442235] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.442317] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.442400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.442476] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.445748] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.445827] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.445910] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.446116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.446264] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.446354] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.446413] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.446549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.446630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.446710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.446788] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.447553] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.447680] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.447763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.447906] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.448068] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.448167] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.448225] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.448373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.448431] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.448508] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.448583] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.449402] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.449595] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.449681] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.449850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.449993] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.450101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.450162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.450296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.450372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.450448] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.450522] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.458856] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.458856] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa1c2520-27f7-4185-a08f-749f3520871d is going to be deleted. [10175.472283] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.472430] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.472505] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.472740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.481721] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.481852] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.482795] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.482901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.488393] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.488495] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.497352] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.497352] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 is going to be deleted. [10175.497665] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.497962] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.518400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.518539] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be deleted. [10175.519517] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.519781] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.540628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.540753] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b696069c-81a6-4243-95fa-f24b214bded3 is going to be deleted. [10175.541799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.542029] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.545835] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.545835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.563234] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.563234] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.564745] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.564859] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99711482-089a-4472-8ac3-fb1d995ba6dd is going to be deleted. [10175.565751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.565954] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.566061] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.566179] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.566334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.566565] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.566565] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.567101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.572926] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.573084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.573154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.573398] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.573484] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.573533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.626902] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.626902] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.626902] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.628261] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.629346] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.629346] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.631590] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.631717] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.631717] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.632565] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.632565] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.632565] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.848442] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 152e138c-a16f-4ab1-ae1d-27177515f5d0: rpc.has_security_group_logging(os_id): False [10175.869393] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.869545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.869614] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.869817] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.869901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.870178] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.870275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.870337] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.870487] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.870558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.870644] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 is going to be created. [10175.907655] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.907918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.907991] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.908225] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.908397] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.908500] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.910095] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.910095] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.910095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.910095] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.937223] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.938327] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.938327] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.938327] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.939384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.939384] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.939384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.939384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.939384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.939384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.939384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.939384] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.939384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.939384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.939731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.939731] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.940079] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.940153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.940282] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.940361] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.940441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.940523] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.942487] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.942487] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.942487] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.945187] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.945388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.953818] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.953818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.953818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.953818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.954050] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.954050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.954050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.954149] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.954220] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.954302] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.954439] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.954529] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.954586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.954719] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.954863] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.954935] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.954990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.955134] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.955208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.955286] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.955371] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.956853] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.956965] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.957087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.957182] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.957319] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.957524] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.957524] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.957597] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.957661] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.957751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.957901] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.957988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.958054] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.958185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.958310] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.958392] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.958447] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.958572] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.958639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.958713] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.958823] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.961169] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.961307] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.961372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.961524] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.961671] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.961771] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.961830] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.964872] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.964872] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.964872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.964872] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.964872] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.965448] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.965448] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.965448] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.965565] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.965954] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.965954] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.965954] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.965954] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.967221] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.967221] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.967221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10175.967221] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.967853] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10175.970622] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 in Status: IN_PROGRESS for 2s [10176.169033] env[65939]: INFO networking_nsxv3.common.synchronization [req-f82dcf98-1bca-4392-a6b8-a6a3aa227677 req-5f5ce8e4-d682-4d31-b7aa-a83bad8911bd service nova] Enqueued Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_rules [10176.169033] env[65939]: INFO networking_nsxv3.common.synchronization [req-f82dcf98-1bca-4392-a6b8-a6a3aa227677 req-5f5ce8e4-d682-4d31-b7aa-a83bad8911bd service nova] Enqueued Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_members [10176.169033] env[65939]: INFO networking_nsxv3.common.synchronization [req-f82dcf98-1bca-4392-a6b8-a6a3aa227677 req-5f5ce8e4-d682-4d31-b7aa-a83bad8911bd service nova] Enqueued Resource ID: 26c1ddc7-cad1-4102-857d-50b27cc94a49 with Priority: HIGHEST for action port [10176.169033] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_rules [10176.169033] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_members [10176.169033] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26c1ddc7-cad1-4102-857d-50b27cc94a49 with Priority: HIGHEST for action port [10176.169033] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0448a07-8b92-443f-84c4-39c4126ca3d2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.169033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.169033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.169750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.169750] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10176.170035] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0448a07-8b92-443f-84c4-39c4126ca3d2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.170156] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.170233] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.170401] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.170550] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.170656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.171263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.171263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.171263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.171263] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10176.173572] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-26c1ddc7-cad1-4102-857d-50b27cc94a49 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.173572] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26c1ddc7-cad1-4102-857d-50b27cc94a49" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.173572] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26c1ddc7-cad1-4102-857d-50b27cc94a49" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.173572] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26c1ddc7-cad1-4102-857d-50b27cc94a49" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.173572] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26c1ddc7-cad1-4102-857d-50b27cc94a49',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10176.417504] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32: rpc.has_security_group_logging(os_id): False [10176.438916] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.439244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.439244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.439346] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.449934] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62f0f078-b1aa-4721-8b07-eb126a6fb449: rpc.has_security_group_logging(os_id): False [10176.450665] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4361c451-dad4-41c4-b71f-bbfd50f8ea0d: rpc.has_security_group_logging(os_id): False [10176.460391] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ac3248a-183f-4532-817e-246814962f51: rpc.has_security_group_logging(os_id): False [10176.464543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.465247] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.465247] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.465247] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.465247] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.465543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.465543] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.465646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.465646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.465795] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.466481] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.466735] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.466960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.466960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.467095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.468899] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.468899] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be updated. [10176.469514] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.469514] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.469514] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.469514] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.472041] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f040ac16-496e-4b1e-b10a-6e1bc87cecaa: rpc.has_security_group_logging(os_id): False [10176.473090] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed701299-54b2-4fb1-b7d6-f2f2b3925210: rpc.has_security_group_logging(os_id): False [10176.474958] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4415b353-eee7-421d-a222-35308d9d05b7: rpc.has_security_group_logging(os_id): False [10176.476730] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95cc14d0-8b63-4ace-a5e1-f800e80faf90: rpc.has_security_group_logging(os_id): False [10176.478127] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 333e0845-02d8-4c70-8281-e3130037fa8e: rpc.has_security_group_logging(os_id): False [10176.484179] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.484179] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.486938] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.486938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.507615] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.507789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.511395] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.511516] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.512427] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.512575] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.513342] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.513507] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.514158] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.514256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.515065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.515321] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.515409] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.515520] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.515743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.515830] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.515926] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 is going to be updated. [10176.518111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.518111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.539275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.539603] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.539905] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.539905] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.540267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.540426] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.540646] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.540799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.540869] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.541112] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.541171] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.541406] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.541724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.541788] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.542149] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.543310] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.543310] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10176.543970] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.543970] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.548125] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.550250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.564264] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.564528] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.564646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.564710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.567872] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.567872] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.567872] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be updated. [10176.567872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.568444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.593688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.593890] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.594125] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.594248] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.594581] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.594740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.595968] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.596656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.596731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.597320] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.597320] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.598848] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.599090] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.599215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.600051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.600220] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.600419] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 is going to be updated. [10176.602580] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.603121] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.611189] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.611884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.631366] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.631366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.642060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.642060] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.642060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.642060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.642060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.642060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.642060] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.642060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.642060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.642746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.643043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.643443] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.643676] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.643843] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.647128] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.647128] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.647128] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa is going to be updated. [10176.647452] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.647710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.673643] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.673799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.674103] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0448a07-8b92-443f-84c4-39c4126ca3d2 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.674203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.674397] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10176.675439] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26c1ddc7-cad1-4102-857d-50b27cc94a49 with status ACTIVE [10176.675629] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.675787] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.675842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.676058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.676420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.676420] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.676606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.676606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.676736] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.678052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.678052] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.678052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.678052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.678052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.678052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.678052] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26c1ddc7-cad1-4102-857d-50b27cc94a49 is going to be updated. [10176.694377] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.694377] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.694377] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.694377] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.694377] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.694377] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.694377] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e is going to be updated. [10176.695088] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.695485] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.751883] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.751883] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.751883] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.751883] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.751883] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.751883] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26c1ddc7-cad1-4102-857d-50b27cc94a49" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.781433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.781433] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.781433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.781433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.781433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.781433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.781433] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 is going to be updated. [10176.782051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.782448] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.782738] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.784190] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.786131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.786131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.790019] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.790019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.790019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.790019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.790019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.790019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.790019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.790019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.791635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.791997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.792283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.793822] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.794296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.848674] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.848902] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.855714] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: IN_PROGRESS for 2s [10176.857630] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: IN_PROGRESS for 2s [10176.858436] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 in Status: IN_PROGRESS for 2s [10176.876824] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10176.881126] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: IN_PROGRESS for 2s [10176.898434] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.898610] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.898852] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.898925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.899177] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.899354] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.899465] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.900103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.900103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.900103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.900103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.900103] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.900412] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.900412] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.900412] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.900552] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.900552] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac3248a-183f-4532-817e-246814962f51 is going to be updated. [10176.901920] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.902101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.902306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.938069] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: IN_PROGRESS for 2s [10176.956977] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10176.956977] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10176.956977] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10176.957340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10176.957414] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10176.998865] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: IN_PROGRESS for 2s [10177.008650] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10177.008840] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10177.009023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10177.009360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10177.009360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10177.030779] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4415b353-eee7-421d-a222-35308d9d05b7 in Status: IN_PROGRESS for 2s [10177.058309] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10177.058586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10177.058657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10177.058866] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10177.059069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10177.079418] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac3248a-183f-4532-817e-246814962f51 in Status: IN_PROGRESS for 2s [10177.162112] env[65939]: INFO networking_nsxv3.common.synchronization [None req-c7929cd9-4631-415c-a68d-1f925e6b5d05 tempest-AttachInterfacesUnderV243Test-430617763 tempest-AttachInterfacesUnderV243Test-430617763-project-member] Enqueued Resource ID: b59b3e53-1a77-49e2-86c1-1dbaca80e272 with Priority: HIGHEST for action security_group_rules [10177.162957] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b59b3e53-1a77-49e2-86c1-1dbaca80e272 with Priority: HIGHEST for action security_group_rules [10177.163268] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10177.163554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10177.164882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10177.164882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10177.164882] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b59b3e53-1a77-49e2-86c1-1dbaca80e272',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10177.179543] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10177.279535] env[65939]: INFO networking_nsxv3.common.synchronization [None req-33ce5260-86d2-478b-97dd-4782b61b95df tempest-AttachInterfacesUnderV243Test-430617763 tempest-AttachInterfacesUnderV243Test-430617763-project-member] Enqueued Resource ID: b59b3e53-1a77-49e2-86c1-1dbaca80e272 with Priority: HIGHEST for action security_group_rules [10177.279702] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b59b3e53-1a77-49e2-86c1-1dbaca80e272 with Priority: HIGHEST for action security_group_rules [10177.279859] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10177.281660] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10177.684357] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10177.684634] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10177.684634] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10177.686098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10177.686175] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10177.686403] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 is going to be created. [10177.692185] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10177.692379] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10177.692438] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10177.692652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10177.692742] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10177.692856] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b59b3e53-1a77-49e2-86c1-1dbaca80e272 already deleted. [10177.692935] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10177.693150] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10177.693311] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10177.693426] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b59b3e53-1a77-49e2-86c1-1dbaca80e272',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10177.712882] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10177.713069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10177.713174] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10177.713353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10177.713531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10177.730617] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 in Status: UNINITIALIZED for 2s [10177.863344] env[65939]: INFO networking_nsxv3.common.synchronization [None req-be28cccd-cd44-44bd-9c0c-fc5eeb225ed7 None None] Enqueued Resource ID: 11ff9f84-7a0e-4019-83f4-e160fabdb59b with Priority: HIGHEST for action port [10177.863885] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ff9f84-7a0e-4019-83f4-e160fabdb59b with Priority: HIGHEST for action port [10177.864639] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-11ff9f84-7a0e-4019-83f4-e160fabdb59b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10177.864639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11ff9f84-7a0e-4019-83f4-e160fabdb59b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10177.864639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11ff9f84-7a0e-4019-83f4-e160fabdb59b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10177.864639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11ff9f84-7a0e-4019-83f4-e160fabdb59b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10177.864849] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11ff9f84-7a0e-4019-83f4-e160fabdb59b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10177.984843] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 in Status: SUCCESS [10177.984843] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.232437] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10178.232731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10178.232731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10178.232889] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10178.232981] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.233093] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b59b3e53-1a77-49e2-86c1-1dbaca80e272 already deleted. [10178.233207] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b59b3e53-1a77-49e2-86c1-1dbaca80e272" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.369204] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11ff9f84-7a0e-4019-83f4-e160fabdb59b [10178.369204] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10178.369204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10178.369204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10178.369204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10178.369204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.369204] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11ff9f84-7a0e-4019-83f4-e160fabdb59b already deleted. [10178.369204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11ff9f84-7a0e-4019-83f4-e160fabdb59b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.677941] env[65939]: INFO networking_nsxv3.common.synchronization [req-c3574174-6a74-4c97-a404-eadfa8f7b33b req-21c6faeb-c4b8-4053-93d7-789bc603e35e tempest-ServerDiskConfigTestJSON-1925570613 tempest-ServerDiskConfigTestJSON-1925570613-project-member] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10178.678515] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10178.678878] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10178.678996] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10178.679389] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10178.679660] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10178.679872] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10178.680022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10178.680110] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10178.680310] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10178.680516] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.680657] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10178.874037] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: SUCCESS [10178.875629] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.875629] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: SUCCESS [10178.875774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.876395] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 in Status: SUCCESS [10178.876548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.895721] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10178.895925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.899324] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: SUCCESS [10178.899517] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10178.955757] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: SUCCESS [10178.955988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.012748] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: SUCCESS [10179.012980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.046390] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4415b353-eee7-421d-a222-35308d9d05b7 in Status: SUCCESS [10179.046614] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.077462] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.077677] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "network-617" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.077853] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "network-617" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.078556] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "network-617" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.078980] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.079256] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.079411] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.079673] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.079857] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.080116] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10179.080406] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10179.080515] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10179.080646] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10179.080761] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10179.080900] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10179.081104] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Looking for TransportZone with name nsx-vlan-transportzone. [10179.099270] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac3248a-183f-4532-817e-246814962f51 in Status: SUCCESS [10179.099528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.103941] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10179.104150] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10179.104323] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10179.104590] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "network-617" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.105070] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.105347] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.105547] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.107110] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.107110] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ccb2ee7-b7bf-47ac-b702-f171bf1335da',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10179.183533] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.183691] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.183740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.183958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.184067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.184261] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.184360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.184421] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.184572] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.184646] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.184733] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be deleted. [10179.192912] env[65939]: INFO networking_nsxv3.common.synchronization [req-ef78f6ef-3e77-4f4c-aa72-c6c75a7c23c3 req-d3624c3e-09ea-4f3a-8e05-90fe2b82741a tempest-SecurityGroupRulesTestJSON-1313565084 tempest-SecurityGroupRulesTestJSON-1313565084-project-member] Enqueued Resource ID: 7b4002c1-1590-4542-8984-b01b15fd486d with Priority: HIGHEST for action security_group_rules [10179.193616] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b4002c1-1590-4542-8984-b01b15fd486d with Priority: HIGHEST for action security_group_rules [10179.193927] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b4002c1-1590-4542-8984-b01b15fd486d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.194063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.194132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.194414] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.194499] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b4002c1-1590-4542-8984-b01b15fd486d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10179.249842] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.250099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.250202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.250506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.250649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.250842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.609451] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.609672] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.609848] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.610725] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.610933] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.611162] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Segment Port 2ccb2ee7-b7bf-47ac-b702-f171bf1335da not found, creating... [10179.611450] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.611652] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.611932] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.612075] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.612247] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.612598] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.612780] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.612966] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.613700] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.613882] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.614109] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Resource: SegmentPort with ID: 2ccb2ee7-b7bf-47ac-b702-f171bf1335da is going to be created. [10179.638527] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.638706] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.638777] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.641055] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.641055] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.641055] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.716545] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.716545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.716545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.716545] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.716818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.716818] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b4002c1-1590-4542-8984-b01b15fd486d already deleted. [10179.716818] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.741470] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 in Status: SUCCESS [10179.741785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.742089] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.742336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.742589] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10179.742751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10179.742802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10179.742952] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10179.743126] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.743176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10179.743269] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10180.245724] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10180.395302] env[65939]: INFO networking_nsxv3.common.synchronization [req-c3574174-6a74-4c97-a404-eadfa8f7b33b req-56865db5-4c82-4e74-a301-f977f6d606f3 service nova] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_rules [10180.395495] env[65939]: INFO networking_nsxv3.common.synchronization [req-c3574174-6a74-4c97-a404-eadfa8f7b33b req-56865db5-4c82-4e74-a301-f977f6d606f3 service nova] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10180.395633] env[65939]: INFO networking_nsxv3.common.synchronization [req-c3574174-6a74-4c97-a404-eadfa8f7b33b req-56865db5-4c82-4e74-a301-f977f6d606f3 service nova] Enqueued Resource ID: 2ccb2ee7-b7bf-47ac-b702-f171bf1335da with Priority: HIGHEST for action port [10180.396844] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_rules [10180.396844] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10180.396844] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ccb2ee7-b7bf-47ac-b702-f171bf1335da with Priority: HIGHEST for action port [10180.397111] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.397177] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.397256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.397506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.397541] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10180.398691] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.399060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.399238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.399409] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.399578] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.399724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.399805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.399994] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.400370] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10180.400445] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10180.401483] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.401601] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.402026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.402026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.402026] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ccb2ee7-b7bf-47ac-b702-f171bf1335da',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10180.748595] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0448a07-8b92-443f-84c4-39c4126ca3d2: rpc.has_security_group_logging(os_id): False [10180.781788] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.784027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.784027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.784027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.784027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10180.784027] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.784027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.784027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.784027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.784027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10180.784027] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 is going to be created. [10180.865998] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.866179] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.866314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.866536] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.866719] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10180.890533] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 in Status: IN_PROGRESS for 2s [10180.907542] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.907542] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.907542] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10180.908221] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ccb2ee7-b7bf-47ac-b702-f171bf1335da with status ACTIVE [10180.908221] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.908375] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.908375] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.908563] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.908746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10180.908982] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.910671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.910671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.910671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.910671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10180.910671] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.910671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.910671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.911036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.911036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10180.911036] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ccb2ee7-b7bf-47ac-b702-f171bf1335da is going to be updated. [10180.952195] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10180.952360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10180.952429] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10180.952639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10180.952773] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10180.952938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ccb2ee7-b7bf-47ac-b702-f171bf1335da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10181.070493] env[65939]: INFO networking_nsxv3.common.synchronization [req-760e41be-4816-4ca4-8994-a319d6d8b3bc req-1ea06439-d31f-4ae4-bc70-8f912ea77361 tempest-SecurityGroupRulesTestJSON-1313565084 tempest-SecurityGroupRulesTestJSON-1313565084-project-member] Enqueued Resource ID: 7b4002c1-1590-4542-8984-b01b15fd486d with Priority: HIGHEST for action security_group_rules [10181.070493] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b4002c1-1590-4542-8984-b01b15fd486d with Priority: HIGHEST for action security_group_rules [10181.071254] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b4002c1-1590-4542-8984-b01b15fd486d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10181.071383] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10181.071452] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10181.071672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10181.071755] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b4002c1-1590-4542-8984-b01b15fd486d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10181.413351] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10181.598717] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10181.598924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10181.598924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10181.599131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10181.599230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10181.599417] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b4002c1-1590-4542-8984-b01b15fd486d already deleted. [10181.599506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10181.920073] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10181.920073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10181.920073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10181.920073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10181.920073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10181.920073] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be created. [10181.946770] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10181.946934] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10181.947011] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10181.947224] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10181.947379] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10181.961667] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: UNINITIALIZED for 2s [10182.004061] env[65939]: INFO networking_nsxv3.common.synchronization [req-3fa0cc23-5e38-4e8a-8d51-c902aa345699 req-2da2d16e-4ab5-456b-ab31-2425ec963f45 tempest-DeleteServersAdminTestJSON-1620884639 tempest-DeleteServersAdminTestJSON-1620884639-project-member] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10182.004715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGHEST for action security_group_members [10182.006158] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.007566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.007626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.008147] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.008344] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.008479] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.008568] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.008687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.008772] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10182.008861] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10182.040043] env[65939]: INFO networking_nsxv3.common.synchronization [req-41aef866-501c-454e-b1d3-7c418b317c98 req-6eb6632b-06b6-4d3e-b69a-a8386c0ed887 tempest-ServerExternalEventsTest-736562566 tempest-ServerExternalEventsTest-736562566-project-member] Enqueued Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGHEST for action security_group_members [10182.040043] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGHEST for action security_group_members [10182.040043] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.040043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.040043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.040043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.040043] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.040685] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.041532] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.041831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.042136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10182.042379] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10182.512156] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.512487] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.512487] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.512626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.512690] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10182.512882] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.512975] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.513043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.513199] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.513261] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10182.513807] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be updated. [10182.547412] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.547628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.547628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.547854] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.547975] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10182.548610] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.548742] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.548811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.549132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.549410] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10182.549548] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac3248a-183f-4532-817e-246814962f51 is going to be updated. [10182.551850] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.551982] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.552230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.552439] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.554305] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10182.569412] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: IN_PROGRESS for 2s [10182.585963] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10182.587086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10182.587086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10182.587086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10182.587086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10182.596230] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac3248a-183f-4532-817e-246814962f51 in Status: IN_PROGRESS for 2s [10182.907697] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 in Status: SUCCESS [10182.907989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10183.972922] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: SUCCESS [10183.973241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10183.973276] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10183.974855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10183.974855] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10183.974855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10183.974855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10183.974855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10183.974855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10183.974855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10183.974855] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10184.059695] env[65939]: INFO networking_nsxv3.common.synchronization [None req-c8e0eae8-8758-4297-a660-ca020f173b0a None None] Enqueued Resource ID: 35d292db-b3e1-47f7-bd57-3a4c423948ef with Priority: HIGHEST for action port [10184.060747] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35d292db-b3e1-47f7-bd57-3a4c423948ef with Priority: HIGHEST for action port [10184.061250] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-35d292db-b3e1-47f7-bd57-3a4c423948ef taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.061441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35d292db-b3e1-47f7-bd57-3a4c423948ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.061542] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35d292db-b3e1-47f7-bd57-3a4c423948ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.062142] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35d292db-b3e1-47f7-bd57-3a4c423948ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.062142] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35d292db-b3e1-47f7-bd57-3a4c423948ef',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10184.250409] env[65939]: INFO networking_nsxv3.common.synchronization [req-af05c319-42ce-487d-9064-6bbfc9a9fbd9 req-6bef37de-e08a-436d-b3a9-3a50866761f3 tempest-ServersAdminTestJSON-304522112 tempest-ServersAdminTestJSON-304522112-project-member] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10184.251351] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10184.251669] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.251864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.251864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.252088] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.252242] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.252340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.252400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.252546] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.252630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.252722] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10184.477222] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.477493] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.477620] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.477898] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.478150] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.478303] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.478445] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.478652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.478790] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.478975] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.479221] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.479444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.479528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.479700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.479905] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.480152] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.480322] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.480559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.480687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.480842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.480997] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10184.564918] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35d292db-b3e1-47f7-bd57-3a4c423948ef [10184.565216] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.565373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.565447] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.565671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.565762] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.565863] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35d292db-b3e1-47f7-bd57-3a4c423948ef already deleted. [10184.565950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35d292db-b3e1-47f7-bd57-3a4c423948ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.579865] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 in Status: SUCCESS [10184.580024] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 deletion is rescheduled due to dependency. [10184.580167] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.610018] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac3248a-183f-4532-817e-246814962f51 in Status: SUCCESS [10184.610233] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac3248a-183f-4532-817e-246814962f51 deletion is rescheduled due to dependency. [10184.610345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.757232] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10184.833367] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.833367] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.833367] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.833569] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.833765] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.833929] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.834058] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.834277] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.834419] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.834618] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10184.834731] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10184.834838] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10184.834944] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10184.835063] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10184.835168] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10184.835297] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Looking for TransportZone with name nsx-vlan-transportzone. [10184.868610] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10184.868820] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10184.868976] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10184.869192] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "network-463" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10184.869531] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10184.869708] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10184.869832] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10184.870189] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10184.870331] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c6e8fdc-4b8b-4b77-96ac-a85097a17227',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10184.985220] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bc9971a-4944-4376-bed1-dab9f3b05345: rpc.has_security_group_logging(os_id): False [10185.004062] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.004062] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.004062] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.004062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.005245] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.005511] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.005724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.007741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.007741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.007741] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be created. [10185.069042] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.069188] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.072023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.072023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.072023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.091551] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: IN_PROGRESS for 2s [10185.262078] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10185.374396] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.374904] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.375111] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.375592] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.375882] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.376192] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Segment Port 5c6e8fdc-4b8b-4b77-96ac-a85097a17227 not found, creating... [10185.376667] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.376974] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.377367] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.377883] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.378249] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.378896] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.379332] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.379516] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.379819] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.379967] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.381321] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Resource: SegmentPort with ID: 5c6e8fdc-4b8b-4b77-96ac-a85097a17227 is going to be created. [10185.414504] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.414740] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.414863] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.415432] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.415674] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.416075] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.768034] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.768034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.768034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.768034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.768034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.768034] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10185.803325] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10185.803325] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10185.803325] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10185.803325] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10185.803325] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10185.812770] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10186.102402] env[65939]: INFO networking_nsxv3.common.synchronization [req-af05c319-42ce-487d-9064-6bbfc9a9fbd9 req-1836209d-56a2-469b-b9e7-881f6199c1a9 service nova] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_rules [10186.102402] env[65939]: INFO networking_nsxv3.common.synchronization [req-af05c319-42ce-487d-9064-6bbfc9a9fbd9 req-1836209d-56a2-469b-b9e7-881f6199c1a9 service nova] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10186.102691] env[65939]: INFO networking_nsxv3.common.synchronization [req-af05c319-42ce-487d-9064-6bbfc9a9fbd9 req-1836209d-56a2-469b-b9e7-881f6199c1a9 service nova] Enqueued Resource ID: 5c6e8fdc-4b8b-4b77-96ac-a85097a17227 with Priority: HIGHEST for action port [10186.105713] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_rules [10186.105816] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10186.105996] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6e8fdc-4b8b-4b77-96ac-a85097a17227 with Priority: HIGHEST for action port [10186.106717] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.106861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.106948] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10186.107192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10186.107292] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10186.108445] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.108561] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.108852] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.108960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.109107] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10186.109316] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10186.110180] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c6e8fdc-4b8b-4b77-96ac-a85097a17227',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10186.178063] env[65939]: INFO networking_nsxv3.common.synchronization [None req-a9466347-2cdc-4a82-a294-0ec25829eed6 None None] Enqueued Resource ID: 48906129-3712-4445-a7f2-1f0cc7750d68 with Priority: HIGHEST for action port [10186.178063] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48906129-3712-4445-a7f2-1f0cc7750d68 with Priority: HIGHEST for action port [10186.178063] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-48906129-3712-4445-a7f2-1f0cc7750d68 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.179912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48906129-3712-4445-a7f2-1f0cc7750d68" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.179912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48906129-3712-4445-a7f2-1f0cc7750d68" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10186.179912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48906129-3712-4445-a7f2-1f0cc7750d68" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10186.180176] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48906129-3712-4445-a7f2-1f0cc7750d68',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10186.613759] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.613871] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.617321] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c6e8fdc-4b8b-4b77-96ac-a85097a17227 with status ACTIVE [10186.617547] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.617678] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.617743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10186.618010] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10186.618170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10186.618303] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.618500] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.618500] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10186.618637] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10186.618710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10186.618928] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.619172] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.619789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10186.619789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10186.619789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10186.619924] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c6e8fdc-4b8b-4b77-96ac-a85097a17227 is going to be updated. [10186.657269] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.657531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.657531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10186.657612] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10186.657694] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10186.657995] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c6e8fdc-4b8b-4b77-96ac-a85097a17227" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10186.682576] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48906129-3712-4445-a7f2-1f0cc7750d68 [10186.682822] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10186.683958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10186.683958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10186.683958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10186.683958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10186.683958] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48906129-3712-4445-a7f2-1f0cc7750d68 already deleted. [10186.683958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48906129-3712-4445-a7f2-1f0cc7750d68" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10187.018276] env[65939]: INFO networking_nsxv3.common.synchronization [req-4f54416f-e677-4085-9188-70af698a5392 req-0db019a8-da55-4ec0-8b0b-4f5a3ab559fb tempest-SecurityGroupRulesTestJSON-1313565084 tempest-SecurityGroupRulesTestJSON-1313565084-project-member] Enqueued Resource ID: 7b4002c1-1590-4542-8984-b01b15fd486d with Priority: HIGHEST for action security_group_rules [10187.020682] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b4002c1-1590-4542-8984-b01b15fd486d with Priority: HIGHEST for action security_group_rules [10187.020682] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b4002c1-1590-4542-8984-b01b15fd486d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10187.020682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10187.020682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10187.020682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10187.020682] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b4002c1-1590-4542-8984-b01b15fd486d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10187.177538] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: SUCCESS [10187.177811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10187.243024] env[65939]: INFO networking_nsxv3.common.synchronization [None req-9344b32e-f1ca-44ff-b9ed-3a8382db443d None None] Enqueued Resource ID: 02dce3dd-24a9-4025-b6fd-70016e48b063 with Priority: HIGHEST for action port [10187.243024] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02dce3dd-24a9-4025-b6fd-70016e48b063 with Priority: HIGHEST for action port [10187.243024] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-02dce3dd-24a9-4025-b6fd-70016e48b063 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10187.243024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02dce3dd-24a9-4025-b6fd-70016e48b063" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10187.243024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02dce3dd-24a9-4025-b6fd-70016e48b063" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10187.243024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02dce3dd-24a9-4025-b6fd-70016e48b063" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10187.243538] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02dce3dd-24a9-4025-b6fd-70016e48b063',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10187.541407] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10187.542420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10187.542420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10187.542420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10187.542420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10187.542420] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b4002c1-1590-4542-8984-b01b15fd486d already deleted. [10187.542420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b4002c1-1590-4542-8984-b01b15fd486d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10187.746659] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02dce3dd-24a9-4025-b6fd-70016e48b063 [10187.747571] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10187.747571] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10187.747571] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10187.747571] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10187.747571] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10187.747571] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02dce3dd-24a9-4025-b6fd-70016e48b063 already deleted. [10187.747571] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02dce3dd-24a9-4025-b6fd-70016e48b063" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10187.833753] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10187.833981] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10187.834173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10187.834384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10187.834566] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10187.834684] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10187.834748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10187.838244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10187.838347] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10187.838450] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10188.342189] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10188.846902] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10189.349492] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10189.350627] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10189.350627] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10189.350627] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10189.350627] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10189.350627] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10189.379954] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10189.380144] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10189.380209] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10189.380416] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10189.380562] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10189.391460] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10189.500275] env[65939]: INFO networking_nsxv3.common.synchronization [req-58d836f3-878b-4563-b2ab-ad3fad67a5bf req-29018263-cd56-41a5-8250-aaf480989b31 tempest-AttachInterfacesV270Test-1816021839 tempest-AttachInterfacesV270Test-1816021839-project-member] Enqueued Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGHEST for action security_group_members [10189.500855] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGHEST for action security_group_members [10189.501383] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10189.501578] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10189.501578] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10189.501826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10189.501985] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10189.502098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10189.502201] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10189.502307] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10189.502388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10189.502480] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10189.953484] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock network-583 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10189.953745] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "network-583" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10189.953900] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "network-583" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10189.954277] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "network-583" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10189.954524] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10189.954841] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10189.954913] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10189.955174] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10189.955355] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10189.955590] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10189.955731] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10189.955844] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10189.955949] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10189.956103] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10189.956238] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10189.956374] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Looking for TransportZone with name nsx-vlan-transportzone. [10189.977235] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10189.978031] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10189.978031] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10189.978378] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "network-583" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10189.978448] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10189.978910] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10189.979117] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10189.979479] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10189.979620] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c08a8b78-8104-4ec2-9e40-4ab98459b6ef',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10190.004400] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10190.004570] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10190.004700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10190.004977] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10190.004977] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10190.005158] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10190.005266] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10190.005323] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10190.005482] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10190.005591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10190.005646] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 already deleted. [10190.005718] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10190.485468] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10190.485468] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10190.485468] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10190.485468] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10190.485468] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10190.485468] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Segment Port c08a8b78-8104-4ec2-9e40-4ab98459b6ef not found, creating... [10190.486084] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10190.486084] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10190.486084] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10190.486084] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10190.486231] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10190.486458] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10190.486563] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10190.487020] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10190.487020] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10190.487020] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10190.488472] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Resource: SegmentPort with ID: c08a8b78-8104-4ec2-9e40-4ab98459b6ef is going to be created. [10190.510794] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10190.510973] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10190.511039] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10190.511320] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10190.511589] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10190.511829] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10190.947054] env[65939]: INFO networking_nsxv3.common.synchronization [None req-8c19b2ce-2f11-4013-b1e1-0029986f88c0 None None] Enqueued Resource ID: 2efac964-4eff-4dd4-80d7-e407814f1175 with Priority: HIGHEST for action port [10190.947675] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2efac964-4eff-4dd4-80d7-e407814f1175 with Priority: HIGHEST for action port [10190.948745] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-2efac964-4eff-4dd4-80d7-e407814f1175 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10190.948872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2efac964-4eff-4dd4-80d7-e407814f1175" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10190.948915] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2efac964-4eff-4dd4-80d7-e407814f1175" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10190.950333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2efac964-4eff-4dd4-80d7-e407814f1175" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10190.950333] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2efac964-4eff-4dd4-80d7-e407814f1175',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10191.204936] env[65939]: INFO networking_nsxv3.common.synchronization [req-58d836f3-878b-4563-b2ab-ad3fad67a5bf req-6fb4a3d9-8cd6-4f34-a1b1-2711f22cdd9b service nova] Enqueued Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGHEST for action security_group_rules [10191.204936] env[65939]: INFO networking_nsxv3.common.synchronization [req-58d836f3-878b-4563-b2ab-ad3fad67a5bf req-6fb4a3d9-8cd6-4f34-a1b1-2711f22cdd9b service nova] Enqueued Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGHEST for action security_group_members [10191.205345] env[65939]: INFO networking_nsxv3.common.synchronization [req-58d836f3-878b-4563-b2ab-ad3fad67a5bf req-6fb4a3d9-8cd6-4f34-a1b1-2711f22cdd9b service nova] Enqueued Resource ID: c08a8b78-8104-4ec2-9e40-4ab98459b6ef with Priority: HIGHEST for action port [10191.208133] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGHEST for action security_group_rules [10191.208377] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGHEST for action security_group_members [10191.208571] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08a8b78-8104-4ec2-9e40-4ab98459b6ef with Priority: HIGHEST for action port [10191.208994] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.209271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.209614] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.209755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.209875] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10191.215630] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.215630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.215630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.215630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.215630] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.215630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.215630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.215630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.215630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.215630] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10191.215630] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.215630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.215630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.216454] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.216454] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c08a8b78-8104-4ec2-9e40-4ab98459b6ef',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10191.402310] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10191.402651] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.402860] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.403145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.403343] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.403460] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.403533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.403686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.403768] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.403986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.403986] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10191.451874] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2efac964-4eff-4dd4-80d7-e407814f1175 [10191.452109] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.452242] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.452311] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.452528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.452616] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.452712] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2efac964-4eff-4dd4-80d7-e407814f1175 already deleted. [10191.452794] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2efac964-4eff-4dd4-80d7-e407814f1175" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.717647] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10191.720512] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.720778] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.721049] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c08a8b78-8104-4ec2-9e40-4ab98459b6ef with status ACTIVE [10191.721299] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.721530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.721674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.721942] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.722129] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.722613] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.722848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.723026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.725592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.725592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.725592] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.725592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.725592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.725592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.725592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.725592] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c08a8b78-8104-4ec2-9e40-4ab98459b6ef is going to be updated. [10191.751676] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.751676] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.751859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.751998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.752133] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.752303] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c08a8b78-8104-4ec2-9e40-4ab98459b6ef" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.906223] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.906618] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.906781] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.907094] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.907549] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.907877] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.908121] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.908543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.910084] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.910084] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.910084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10191.910599] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10192.163198] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b8961314-5491-4b36-bf1c-622f9a96f871 None None] Enqueued Resource ID: d517034c-26c8-40a8-a99d-af91eed040e0 with Priority: HIGHEST for action port [10192.163198] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d517034c-26c8-40a8-a99d-af91eed040e0 with Priority: HIGHEST for action port [10192.163198] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-d517034c-26c8-40a8-a99d-af91eed040e0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10192.163198] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d517034c-26c8-40a8-a99d-af91eed040e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10192.163198] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d517034c-26c8-40a8-a99d-af91eed040e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10192.163198] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d517034c-26c8-40a8-a99d-af91eed040e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10192.163198] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d517034c-26c8-40a8-a99d-af91eed040e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10192.226633] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10192.414796] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4361c451-dad4-41c4-b71f-bbfd50f8ea0d: rpc.has_security_group_logging(os_id): False [10192.432570] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10192.433356] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10192.433581] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10192.435018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10192.435018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10192.435018] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10192.435018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10192.435018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10192.435018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10192.435018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10192.435018] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10192.435018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10192.435729] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10192.436735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10192.436735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10192.436735] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10192.436735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10192.436735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10192.436735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10192.437310] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10192.439098] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10192.501925] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10192.501925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10192.501925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10192.501925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10192.501925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10192.516664] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10192.667101] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d517034c-26c8-40a8-a99d-af91eed040e0 [10192.667101] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10192.667236] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10192.667269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10192.667496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10192.667686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10192.667686] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d517034c-26c8-40a8-a99d-af91eed040e0 already deleted. [10192.667773] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d517034c-26c8-40a8-a99d-af91eed040e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10192.729178] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10192.729178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10192.729178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10192.729178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10192.729178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10192.729178] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 is going to be created. [10192.753067] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10192.755888] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10192.755888] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10192.755888] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10192.757223] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10192.770025] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 in Status: UNINITIALIZED for 2s [10193.060321] env[65939]: INFO networking_nsxv3.common.synchronization [None req-9859a5d8-19f1-4cf3-92b1-ddbe3adb18dd None None] Enqueued Resource ID: 660a413b-7753-4050-ac47-9106d93a939f with Priority: HIGHEST for action port [10193.061367] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660a413b-7753-4050-ac47-9106d93a939f with Priority: HIGHEST for action port [10193.063036] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-660a413b-7753-4050-ac47-9106d93a939f taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10193.063036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-660a413b-7753-4050-ac47-9106d93a939f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10193.063036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-660a413b-7753-4050-ac47-9106d93a939f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10193.063036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-660a413b-7753-4050-ac47-9106d93a939f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10193.063036] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('660a413b-7753-4050-ac47-9106d93a939f',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10193.566186] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 660a413b-7753-4050-ac47-9106d93a939f [10193.566467] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10193.566609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10193.566676] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10193.566892] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10193.566980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10193.567087] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:660a413b-7753-4050-ac47-9106d93a939f already deleted. [10193.567166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-660a413b-7753-4050-ac47-9106d93a939f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10193.973057] env[65939]: INFO networking_nsxv3.common.synchronization [req-06404d48-cc2c-47cd-b8e0-4cc181665f8e req-5bdcd31b-0049-4507-8463-26ce66c0444b tempest-ServerGroupTestJSON-1869202847 tempest-ServerGroupTestJSON-1869202847-project-member] Enqueued Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGHEST for action security_group_members [10193.973790] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGHEST for action security_group_members [10193.976450] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f47963db-7b78-435b-9e39-5f259f042bf4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10193.976450] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10193.976450] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10193.976450] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10193.976905] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10193.976905] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10193.976905] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10193.977063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10193.977063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10193.977165] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10194.366019] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.366019] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-113" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.366019] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-113" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.366019] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-113" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.366489] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.366795] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.367608] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.368033] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.368320] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.368632] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10194.368845] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10194.370811] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10194.370811] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10194.370811] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10194.370811] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10194.370811] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10194.393028] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10194.393028] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10194.393028] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10194.393028] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-113" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.393370] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-a5824832-02aa-43c4-9466-180fed9f742e taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.393575] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-a5824832-02aa-43c4-9466-180fed9f742e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.393689] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-a5824832-02aa-43c4-9466-180fed9f742e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.394417] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-a5824832-02aa-43c4-9466-180fed9f742e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.394417] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5824832-02aa-43c4-9466-180fed9f742e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10194.480652] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.480811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.481673] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.481904] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.481997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.482908] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.483037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.483100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.483263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.483345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.483436] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f47963db-7b78-435b-9e39-5f259f042bf4 already deleted. [10194.483516] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.532960] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10194.534249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.591992] env[65939]: INFO networking_nsxv3.common.synchronization [None req-5f5deba0-37da-488b-b878-db6946219e5a None None] Enqueued Resource ID: 0671af02-2b7a-4e91-9485-9e6e191e0bdc with Priority: HIGHEST for action port [10194.592595] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0671af02-2b7a-4e91-9485-9e6e191e0bdc with Priority: HIGHEST for action port [10194.592907] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-0671af02-2b7a-4e91-9485-9e6e191e0bdc taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.593201] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0671af02-2b7a-4e91-9485-9e6e191e0bdc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.593318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0671af02-2b7a-4e91-9485-9e6e191e0bdc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.593850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0671af02-2b7a-4e91-9485-9e6e191e0bdc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.593980] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0671af02-2b7a-4e91-9485-9e6e191e0bdc',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10194.783060] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 in Status: SUCCESS [10194.783060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.783060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.783060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.783060] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.783060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.783060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.783891] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.783891] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.783891] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.783891] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10194.859577] env[65939]: INFO networking_nsxv3.common.synchronization [None req-516a71f6-eee3-4f8b-99d4-14a3255b0171 tempest-ServersTestJSON-388458959 tempest-ServersTestJSON-388458959-project-member] Enqueued Resource ID: 0be7f18f-3088-4f35-b83e-5f353cf772b9 with Priority: HIGHEST for action security_group_rules [10194.860219] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0be7f18f-3088-4f35-b83e-5f353cf772b9 with Priority: HIGHEST for action security_group_rules [10194.860510] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0be7f18f-3088-4f35-b83e-5f353cf772b9 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.860639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0be7f18f-3088-4f35-b83e-5f353cf772b9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.860743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0be7f18f-3088-4f35-b83e-5f353cf772b9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.860960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0be7f18f-3088-4f35-b83e-5f353cf772b9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.861058] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0be7f18f-3088-4f35-b83e-5f353cf772b9',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10194.895827] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.896067] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.896236] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.896526] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.896688] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.896853] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port a5824832-02aa-43c4-9466-180fed9f742e not found, creating... [10194.897200] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.897356] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.897475] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.897699] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.897844] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.899181] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.899181] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.899181] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.899181] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.899181] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.899181] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: a5824832-02aa-43c4-9466-180fed9f742e is going to be created. [10194.923750] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10194.923990] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10194.924092] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10194.924477] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10194.924842] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10194.925147] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-a5824832-02aa-43c4-9466-180fed9f742e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.046367] env[65939]: INFO networking_nsxv3.common.synchronization [None req-8e361556-a799-467c-8245-ea208e23b58b tempest-ServersTestJSON-388458959 tempest-ServersTestJSON-388458959-project-member] Enqueued Resource ID: 0be7f18f-3088-4f35-b83e-5f353cf772b9 with Priority: HIGHEST for action security_group_rules [10195.048527] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0be7f18f-3088-4f35-b83e-5f353cf772b9 with Priority: HIGHEST for action security_group_rules [10195.048654] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0be7f18f-3088-4f35-b83e-5f353cf772b9 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.048778] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0be7f18f-3088-4f35-b83e-5f353cf772b9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.098182] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0671af02-2b7a-4e91-9485-9e6e191e0bdc [10195.098437] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.098591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.098669] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.098866] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.098949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.099216] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0671af02-2b7a-4e91-9485-9e6e191e0bdc already deleted. [10195.099354] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0671af02-2b7a-4e91-9485-9e6e191e0bdc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.286196] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.286415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.286541] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.286866] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.287264] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.287383] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.287420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.287684] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.287838] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.288025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.288262] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.288419] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.288530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.288770] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.289013] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.289203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.289263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.289490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.289657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.289727] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.289783] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10195.381996] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.382172] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.382243] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.382444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.382537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.382630] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0be7f18f-3088-4f35-b83e-5f353cf772b9 already deleted. [10195.382757] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0be7f18f-3088-4f35-b83e-5f353cf772b9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.382939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0be7f18f-3088-4f35-b83e-5f353cf772b9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.383134] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0be7f18f-3088-4f35-b83e-5f353cf772b9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.383220] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0be7f18f-3088-4f35-b83e-5f353cf772b9',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10195.648971] env[65939]: INFO networking_nsxv3.common.synchronization [req-06404d48-cc2c-47cd-b8e0-4cc181665f8e req-8e1d8cff-9e16-4dd2-a858-1dd5ad26c9d7 service nova] Enqueued Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGHEST for action security_group_rules [10195.652218] env[65939]: INFO networking_nsxv3.common.synchronization [req-06404d48-cc2c-47cd-b8e0-4cc181665f8e req-8e1d8cff-9e16-4dd2-a858-1dd5ad26c9d7 service nova] Enqueued Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGHEST for action security_group_members [10195.652218] env[65939]: INFO networking_nsxv3.common.synchronization [req-06404d48-cc2c-47cd-b8e0-4cc181665f8e req-8e1d8cff-9e16-4dd2-a858-1dd5ad26c9d7 service nova] Enqueued Resource ID: a5824832-02aa-43c4-9466-180fed9f742e with Priority: HIGHEST for action port [10195.652218] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGHEST for action security_group_rules [10195.652218] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGHEST for action security_group_members [10195.652218] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5824832-02aa-43c4-9466-180fed9f742e with Priority: HIGHEST for action port [10195.652639] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f47963db-7b78-435b-9e39-5f259f042bf4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.652923] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.653142] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.653698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.653925] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10195.657099] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f47963db-7b78-435b-9e39-5f259f042bf4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.657099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.657099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.657099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.657099] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.657099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.657099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.657099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.657099] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.657099] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10195.658259] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5824832-02aa-43c4-9466-180fed9f742e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.658259] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5824832-02aa-43c4-9466-180fed9f742e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.659103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5824832-02aa-43c4-9466-180fed9f742e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.660731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5824832-02aa-43c4-9466-180fed9f742e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.660844] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5824832-02aa-43c4-9466-180fed9f742e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10195.687147] env[65939]: INFO networking_nsxv3.common.synchronization [None req-e201cb2a-4994-4602-9d80-ab7d7e07ad7a None None] Enqueued Resource ID: ae248883-f07b-4b36-adef-756dad3f1e2f with Priority: HIGHEST for action port [10195.687886] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae248883-f07b-4b36-adef-756dad3f1e2f with Priority: HIGHEST for action port [10195.689751] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae248883-f07b-4b36-adef-756dad3f1e2f taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.689909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae248883-f07b-4b36-adef-756dad3f1e2f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.689981] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae248883-f07b-4b36-adef-756dad3f1e2f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.691045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae248883-f07b-4b36-adef-756dad3f1e2f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.691045] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae248883-f07b-4b36-adef-756dad3f1e2f',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10195.792404] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0: rpc.has_security_group_logging(os_id): False [10195.813811] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.813983] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.814051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.814275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.814619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.814619] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.814699] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.814767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.814891] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.814936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.815385] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.815575] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.815645] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.815859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.815966] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.816335] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.816434] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.816481] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.816642] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.816711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.816799] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 is going to be created. [10195.884321] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.884476] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.884556] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.884933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.885032] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.899597] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 in Status: IN_PROGRESS for 2s [10195.908523] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10195.908523] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10195.908523] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10195.908816] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10195.909021] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10195.909199] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0be7f18f-3088-4f35-b83e-5f353cf772b9 already deleted. [10195.909250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0be7f18f-3088-4f35-b83e-5f353cf772b9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10196.167132] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10196.167132] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f47963db-7b78-435b-9e39-5f259f042bf4 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10196.167132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10196.167132] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5824832-02aa-43c4-9466-180fed9f742e with status ACTIVE [10196.167132] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10196.167132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10196.167132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10196.167132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10196.167132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10196.167132] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10196.167132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10196.167132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10196.167132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10196.167132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10196.167874] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10196.168071] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10196.168257] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10196.168483] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10196.168716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10196.168881] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5824832-02aa-43c4-9466-180fed9f742e is going to be updated. [10196.193652] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10196.193789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10196.193789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10196.193987] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10196.194139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10196.194318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5824832-02aa-43c4-9466-180fed9f742e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10196.194873] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae248883-f07b-4b36-adef-756dad3f1e2f [10196.194873] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10196.194873] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10196.194873] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10196.195074] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10196.195226] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10196.195226] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae248883-f07b-4b36-adef-756dad3f1e2f already deleted. [10196.195285] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae248883-f07b-4b36-adef-756dad3f1e2f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10196.671452] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10197.178537] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10197.178920] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10197.178920] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10197.179150] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10197.179150] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10197.179279] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f47963db-7b78-435b-9e39-5f259f042bf4 is going to be created. [10197.203863] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10197.204017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10197.204085] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10197.204292] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10197.204450] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10197.216066] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f47963db-7b78-435b-9e39-5f259f042bf4 in Status: UNINITIALIZED for 2s [10197.915585] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 in Status: SUCCESS [10197.915793] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10197.981736] env[65939]: INFO networking_nsxv3.common.synchronization [req-6fb430ae-ac49-428a-a888-eb3d53b02d0a req-3964e62a-b7bc-49d3-b740-84b3f132521d tempest-ServerActionsTestOtherA-1770217961 tempest-ServerActionsTestOtherA-1770217961-project-member] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_members [10197.982342] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_members [10197.982654] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10197.982776] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10197.982841] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10197.983130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10197.983295] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10197.983391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10197.983451] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10197.983604] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10197.983702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10197.983797] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10198.314021] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-277 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10198.314322] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-277" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10198.314363] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-277" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10198.314717] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-277" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10198.314980] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10198.318568] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10198.318756] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10198.318990] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10198.319128] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10198.319345] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10198.319463] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10198.319573] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10198.319678] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10198.319785] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10198.319888] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10198.320033] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10198.339891] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10198.340068] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10198.340208] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10198.340413] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-277" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10198.340724] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-15337075-b0cc-433d-8531-8f47f82f3ffe taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10198.340910] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-15337075-b0cc-433d-8531-8f47f82f3ffe" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10198.341044] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-15337075-b0cc-433d-8531-8f47f82f3ffe" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10198.341385] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-15337075-b0cc-433d-8531-8f47f82f3ffe" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10198.341529] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15337075-b0cc-433d-8531-8f47f82f3ffe',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10198.486015] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10198.486216] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10198.486285] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10198.486536] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10198.486629] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10198.486832] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10198.486928] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10198.486989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10198.487151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10198.487226] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10198.487309] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 already deleted. [10198.487388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10198.847180] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10198.847537] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10198.847615] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10198.847842] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10198.848096] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10198.848273] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 15337075-b0cc-433d-8531-8f47f82f3ffe not found, creating... [10198.851253] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10198.851253] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10198.851253] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10198.851253] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10198.851253] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10198.851253] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10198.851253] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10198.851253] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10198.851253] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10198.851253] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10198.851621] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 15337075-b0cc-433d-8531-8f47f82f3ffe is going to be created. [10198.870361] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10198.870591] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10198.870679] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10198.870961] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10198.871227] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10198.871957] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-15337075-b0cc-433d-8531-8f47f82f3ffe" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10199.226865] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f47963db-7b78-435b-9e39-5f259f042bf4 in Status: SUCCESS [10199.229312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10199.229312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.229312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.229312] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10199.229312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10199.229312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.229312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.229312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10199.229312] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10199.229312] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10199.640814] env[65939]: INFO networking_nsxv3.common.synchronization [req-6fb430ae-ac49-428a-a888-eb3d53b02d0a req-fdf69c65-b3bb-4b78-82c5-4ea2963ce0ee service nova] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_rules [10199.640814] env[65939]: INFO networking_nsxv3.common.synchronization [req-6fb430ae-ac49-428a-a888-eb3d53b02d0a req-fdf69c65-b3bb-4b78-82c5-4ea2963ce0ee service nova] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_members [10199.640814] env[65939]: INFO networking_nsxv3.common.synchronization [req-6fb430ae-ac49-428a-a888-eb3d53b02d0a req-fdf69c65-b3bb-4b78-82c5-4ea2963ce0ee service nova] Enqueued Resource ID: 15337075-b0cc-433d-8531-8f47f82f3ffe with Priority: HIGHEST for action port [10199.640814] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_rules [10199.640814] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_members [10199.640814] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15337075-b0cc-433d-8531-8f47f82f3ffe with Priority: HIGHEST for action port [10199.640814] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10199.640814] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10199.640814] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.640814] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.640814] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10199.642860] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10199.642963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10199.643047] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.643254] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.643460] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10199.643600] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10199.643650] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.643777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.644129] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10199.644297] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10199.645167] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-15337075-b0cc-433d-8531-8f47f82f3ffe taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10199.646079] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15337075-b0cc-433d-8531-8f47f82f3ffe" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10199.646120] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15337075-b0cc-433d-8531-8f47f82f3ffe" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.646317] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15337075-b0cc-433d-8531-8f47f82f3ffe" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.646400] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15337075-b0cc-433d-8531-8f47f82f3ffe',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10199.735217] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f47963db-7b78-435b-9e39-5f259f042bf4 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.735217] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10199.735217] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f47963db-7b78-435b-9e39-5f259f042bf4 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.735217] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10199.735217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10199.736332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10199.736332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10199.736332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10199.736332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10199.736332] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10200.032854] env[65939]: INFO networking_nsxv3.common.synchronization [None req-4e3a08ff-1d7c-4ca7-b0c5-c43a011d4141 None None] Enqueued Resource ID: f6751ced-6f58-46cd-9ad3-b2aed982359d with Priority: HIGHEST for action port [10200.033879] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6751ced-6f58-46cd-9ad3-b2aed982359d with Priority: HIGHEST for action port [10200.033879] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6751ced-6f58-46cd-9ad3-b2aed982359d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.033879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6751ced-6f58-46cd-9ad3-b2aed982359d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.033879] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6751ced-6f58-46cd-9ad3-b2aed982359d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.034140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6751ced-6f58-46cd-9ad3-b2aed982359d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.034348] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6751ced-6f58-46cd-9ad3-b2aed982359d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10200.148180] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10200.149349] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.149529] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.149656] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15337075-b0cc-433d-8531-8f47f82f3ffe with status ACTIVE [10200.149831] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.150345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.150462] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.150721] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.150833] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.151081] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.151195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.151257] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.151446] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.151516] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.151701] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.151796] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.152155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.152334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.152422] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.152511] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15337075-b0cc-433d-8531-8f47f82f3ffe is going to be updated. [10200.175741] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.175975] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.176107] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.176365] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.176517] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.176927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15337075-b0cc-433d-8531-8f47f82f3ffe" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.244032] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f47963db-7b78-435b-9e39-5f259f042bf4: rpc.has_security_group_logging(os_id): False [10200.264474] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.264828] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.264828] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.264951] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.265109] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.265377] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.265539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.265608] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.265910] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.266017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.266162] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.266263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.266320] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.266472] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.266547] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.266775] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.267073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.267073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.267073] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.267201] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.267201] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f47963db-7b78-435b-9e39-5f259f042bf4 is going to be created. [10200.388652] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.388884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.388884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.389197] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.389411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.420412] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f47963db-7b78-435b-9e39-5f259f042bf4 in Status: IN_PROGRESS for 2s [10200.536830] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6751ced-6f58-46cd-9ad3-b2aed982359d [10200.536830] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10200.537082] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10200.537082] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10200.537408] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10200.537478] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.537551] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6751ced-6f58-46cd-9ad3-b2aed982359d already deleted. [10200.537631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6751ced-6f58-46cd-9ad3-b2aed982359d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10200.656102] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10201.161366] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10201.161366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10201.161366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10201.161366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10201.161542] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10201.161542] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 is going to be created. [10201.204498] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10201.204733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10201.204841] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10201.205034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10201.205254] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10201.216668] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: UNINITIALIZED for 2s [10202.221936] env[65939]: INFO networking_nsxv3.common.synchronization [None req-3db9c660-041f-4c3b-b95f-0190b370fa9d None None] Enqueued Resource ID: dfe3854c-8a0b-462a-86d9-5643ee73c840 with Priority: HIGHEST for action port [10202.221936] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfe3854c-8a0b-462a-86d9-5643ee73c840 with Priority: HIGHEST for action port [10202.221936] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfe3854c-8a0b-462a-86d9-5643ee73c840 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10202.221936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfe3854c-8a0b-462a-86d9-5643ee73c840" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10202.222997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfe3854c-8a0b-462a-86d9-5643ee73c840" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10202.224434] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfe3854c-8a0b-462a-86d9-5643ee73c840" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10202.224434] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe3854c-8a0b-462a-86d9-5643ee73c840',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10202.438591] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f47963db-7b78-435b-9e39-5f259f042bf4 in Status: SUCCESS [10202.438884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10202.728570] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfe3854c-8a0b-462a-86d9-5643ee73c840 [10202.728570] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10202.728877] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10202.728877] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10202.729144] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10202.729144] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10202.729283] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfe3854c-8a0b-462a-86d9-5643ee73c840 already deleted. [10202.729407] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfe3854c-8a0b-462a-86d9-5643ee73c840" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10203.228543] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: SUCCESS [10203.228543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10203.228543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10203.228543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10203.230170] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10203.230170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10203.230170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10203.230170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10203.230170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10203.230170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10203.230524] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10203.429345] env[65939]: INFO networking_nsxv3.common.synchronization [req-244d854e-9556-4b4d-bf1a-7e3d9bb6c6d9 req-345ddbf9-926e-4538-b7e3-790925ec2419 tempest-ServersAdminNegativeTestJSON-58030456 tempest-ServersAdminNegativeTestJSON-58030456-project-member] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10203.430496] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10203.430496] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10203.430496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10203.430496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10203.430890] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10203.430890] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10203.430890] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10203.430890] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10203.431129] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10203.431129] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10203.431242] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10203.733855] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10203.934018] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10204.239326] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685: rpc.has_security_group_logging(os_id): False [10204.260076] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10204.260076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10204.260076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10204.260076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10204.260263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10204.260398] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10204.260501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10204.260571] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10204.261210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10204.261210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10204.261210] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 is going to be created. [10204.340842] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10204.340842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10204.340842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10204.340842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10204.340842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10204.355328] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: IN_PROGRESS for 2s [10204.436536] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10204.942267] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10204.942267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10204.942267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10204.942267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10204.942267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10204.942267] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be updated. [10204.976104] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10204.976334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10204.976404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10204.976791] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10204.976791] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10204.987245] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: IN_PROGRESS for 2s [10205.410055] env[65939]: INFO networking_nsxv3.common.synchronization [None req-91f5571f-6a31-4f9c-a4b9-5e4f8e03b018 None None] Enqueued Resource ID: c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b with Priority: HIGHEST for action port [10205.410635] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b with Priority: HIGHEST for action port [10205.411216] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10205.411216] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10205.413629] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10205.414043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10205.414043] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10205.917539] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b [10205.917539] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10205.917539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10205.917539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10205.917539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10205.917539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10205.917539] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b already deleted. [10205.917539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c80f958b-d21a-4f0b-a592-6d3ca1aeeb3b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10206.153520] env[65939]: INFO networking_nsxv3.common.synchronization [None req-6f1bdef2-f8d9-420c-8313-d6177893ee6f None None] Enqueued Resource ID: df3f282b-96ba-48ec-9f50-dd307fdeb30e with Priority: HIGHEST for action port [10206.153520] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df3f282b-96ba-48ec-9f50-dd307fdeb30e with Priority: HIGHEST for action port [10206.153520] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-df3f282b-96ba-48ec-9f50-dd307fdeb30e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10206.153520] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df3f282b-96ba-48ec-9f50-dd307fdeb30e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10206.153835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df3f282b-96ba-48ec-9f50-dd307fdeb30e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10206.154042] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df3f282b-96ba-48ec-9f50-dd307fdeb30e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10206.154107] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df3f282b-96ba-48ec-9f50-dd307fdeb30e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10206.370463] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: SUCCESS [10206.370463] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10206.657176] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df3f282b-96ba-48ec-9f50-dd307fdeb30e [10206.658173] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10206.658357] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10206.658435] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10206.658654] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10206.658747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10206.658844] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df3f282b-96ba-48ec-9f50-dd307fdeb30e already deleted. [10206.659319] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df3f282b-96ba-48ec-9f50-dd307fdeb30e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10207.000695] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: SUCCESS [10207.000853] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10208.091896] env[65939]: INFO networking_nsxv3.common.synchronization [None req-172bd97e-0189-4981-8964-9ccae3721cb9 tempest-ServerActionsTestOtherB-2041929730 tempest-ServerActionsTestOtherB-2041929730-project-member] Enqueued Resource ID: d63f8cc4-049d-48a7-9c3b-0a6b943a6096 with Priority: HIGHEST for action security_group_rules [10208.092634] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d63f8cc4-049d-48a7-9c3b-0a6b943a6096 with Priority: HIGHEST for action security_group_rules [10208.093124] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10208.093300] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10208.093521] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10208.094129] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10208.094266] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d63f8cc4-049d-48a7-9c3b-0a6b943a6096',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10208.278173] env[65939]: INFO networking_nsxv3.common.synchronization [None req-2326d0e8-2749-47f3-b7f7-304a9ba44439 tempest-ServerActionsTestOtherB-2041929730 tempest-ServerActionsTestOtherB-2041929730-project-member] Enqueued Resource ID: d63f8cc4-049d-48a7-9c3b-0a6b943a6096 with Priority: HIGHEST for action security_group_rules [10208.278766] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d63f8cc4-049d-48a7-9c3b-0a6b943a6096 with Priority: HIGHEST for action security_group_rules [10208.280593] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10208.280733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10208.338479] env[65939]: INFO networking_nsxv3.common.synchronization [None req-96d0a6e7-f22c-430f-b64c-defa916da551 None None] Enqueued Resource ID: e450b720-8600-4e4d-9a84-b73c5b4641e3 with Priority: HIGHEST for action port [10208.338904] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e450b720-8600-4e4d-9a84-b73c5b4641e3 with Priority: HIGHEST for action port [10208.339263] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-e450b720-8600-4e4d-9a84-b73c5b4641e3 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10208.339377] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e450b720-8600-4e4d-9a84-b73c5b4641e3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10208.339438] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e450b720-8600-4e4d-9a84-b73c5b4641e3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10208.339712] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e450b720-8600-4e4d-9a84-b73c5b4641e3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10208.339812] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e450b720-8600-4e4d-9a84-b73c5b4641e3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10208.623025] env[65939]: INFO networking_nsxv3.common.synchronization [None req-fb259ec3-08de-415c-8cc7-ea66c9a3e2ec None None] Enqueued Resource ID: f56a4dc7-a011-4c6b-aae1-7a332739751b with Priority: HIGHEST for action port [10208.623025] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f56a4dc7-a011-4c6b-aae1-7a332739751b with Priority: HIGHEST for action port [10208.627741] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10208.627741] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d63f8cc4-049d-48a7-9c3b-0a6b943a6096 already deleted. [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10208.627741] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f56a4dc7-a011-4c6b-aae1-7a332739751b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f56a4dc7-a011-4c6b-aae1-7a332739751b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f56a4dc7-a011-4c6b-aae1-7a332739751b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f56a4dc7-a011-4c6b-aae1-7a332739751b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10208.627741] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f56a4dc7-a011-4c6b-aae1-7a332739751b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10208.627741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10208.629523] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d63f8cc4-049d-48a7-9c3b-0a6b943a6096',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10208.654367] env[65939]: INFO networking_nsxv3.common.synchronization [req-a57acb7c-2c96-4170-8f1f-6582d11ca7ee req-fb0e2ab2-f45f-40e8-807c-d22fce5dd532 tempest-AttachVolumeTestJSON-692976414 tempest-AttachVolumeTestJSON-692976414-project-member] Enqueued Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_members [10208.657176] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_members [10208.657176] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f93f7997-4b3f-423d-a690-47bbfb3c31ee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10208.657176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10208.657176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10208.657176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10208.657176] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10208.657176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10208.657176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10208.657176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10208.657176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10208.657623] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10208.842667] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e450b720-8600-4e4d-9a84-b73c5b4641e3 [10208.842915] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10208.843782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10208.843782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10208.843782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10208.843782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10208.843782] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e450b720-8600-4e4d-9a84-b73c5b4641e3 already deleted. [10208.843782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e450b720-8600-4e4d-9a84-b73c5b4641e3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.131944] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f56a4dc7-a011-4c6b-aae1-7a332739751b [10209.132269] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.132425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.135093] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.135093] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.135093] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.135093] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f56a4dc7-a011-4c6b-aae1-7a332739751b already deleted. [10209.135093] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f56a4dc7-a011-4c6b-aae1-7a332739751b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.155544] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.157025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.157025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.157025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.157025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.157025] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d63f8cc4-049d-48a7-9c3b-0a6b943a6096 already deleted. [10209.157025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d63f8cc4-049d-48a7-9c3b-0a6b943a6096" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.161939] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.161939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.161939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.161939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.161939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.161939] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.161939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.161939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.161939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.161939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.161939] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee already deleted. [10209.161939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.283063] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.283063] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-485" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.283063] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-485" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.283063] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-485" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.283063] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.283063] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.283063] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.283063] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.284097] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.284412] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10209.284567] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10209.284725] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10209.284865] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10209.285085] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10209.286807] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10209.286807] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10209.316119] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10209.316119] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10209.316119] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10209.316119] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-485" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.316119] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-8240f3ec-85dc-4104-b697-3ef975f60b42 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.316119] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-8240f3ec-85dc-4104-b697-3ef975f60b42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.316119] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-8240f3ec-85dc-4104-b697-3ef975f60b42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.316119] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-8240f3ec-85dc-4104-b697-3ef975f60b42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.317110] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8240f3ec-85dc-4104-b697-3ef975f60b42',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10209.650905] env[65939]: INFO networking_nsxv3.common.synchronization [req-25ebe4f9-0e23-45d7-8f3c-d583d994a3ee req-ac63405e-8fc8-45ee-b6cb-d479807686c4 tempest-ServerGroupTestJSON-1869202847 tempest-ServerGroupTestJSON-1869202847-project-member] Enqueued Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGHEST for action security_group_members [10209.651535] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGHEST for action security_group_members [10209.651848] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f47963db-7b78-435b-9e39-5f259f042bf4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.651972] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.652121] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.652340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.652499] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.656064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.656064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.656064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.656064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.656064] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10209.822783] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.823031] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.823213] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.823471] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.823668] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.823992] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port 8240f3ec-85dc-4104-b697-3ef975f60b42 not found, creating... [10209.824088] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.824254] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.824372] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.824628] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.824785] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.825081] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.825243] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.825445] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.825634] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.825803] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.825973] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: 8240f3ec-85dc-4104-b697-3ef975f60b42 is going to be created. [10209.850033] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10209.850260] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10209.850376] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10209.850674] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10209.850891] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10209.851134] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-8240f3ec-85dc-4104-b697-3ef975f60b42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10210.159232] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10210.159232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10210.159232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10210.159232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10210.159610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10210.159691] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10210.159826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10210.159908] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10210.160130] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10210.160234] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10210.160347] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f47963db-7b78-435b-9e39-5f259f042bf4 is going to be updated. [10210.191330] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10210.191523] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10210.191572] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10210.191746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10210.191885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10210.204633] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f47963db-7b78-435b-9e39-5f259f042bf4 in Status: IN_PROGRESS for 2s [10210.596209] env[65939]: INFO networking_nsxv3.common.synchronization [req-a57acb7c-2c96-4170-8f1f-6582d11ca7ee req-a6c6796a-208d-4ee1-af21-a9efe09b1a0b service nova] Enqueued Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_rules [10210.596482] env[65939]: INFO networking_nsxv3.common.synchronization [req-a57acb7c-2c96-4170-8f1f-6582d11ca7ee req-a6c6796a-208d-4ee1-af21-a9efe09b1a0b service nova] Enqueued Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_members [10210.596682] env[65939]: INFO networking_nsxv3.common.synchronization [req-a57acb7c-2c96-4170-8f1f-6582d11ca7ee req-a6c6796a-208d-4ee1-af21-a9efe09b1a0b service nova] Enqueued Resource ID: 8240f3ec-85dc-4104-b697-3ef975f60b42 with Priority: HIGHEST for action port [10210.597485] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_rules [10210.597661] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_members [10210.597807] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8240f3ec-85dc-4104-b697-3ef975f60b42 with Priority: HIGHEST for action port [10210.598585] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10210.598755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10210.598885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10210.599192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10210.599382] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10210.601211] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f93f7997-4b3f-423d-a690-47bbfb3c31ee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10210.601386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10210.601488] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10210.601747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10210.601967] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10210.602127] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10210.602224] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10210.602434] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10210.602560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10210.602694] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10210.603808] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-8240f3ec-85dc-4104-b697-3ef975f60b42 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10210.603971] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8240f3ec-85dc-4104-b697-3ef975f60b42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10210.604084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8240f3ec-85dc-4104-b697-3ef975f60b42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10210.604750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8240f3ec-85dc-4104-b697-3ef975f60b42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10210.604870] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8240f3ec-85dc-4104-b697-3ef975f60b42',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10210.904781] env[65939]: INFO networking_nsxv3.common.synchronization [req-9d60eea7-89a9-471a-94c3-fe8f20a4a65f req-93cb00af-f821-4352-9234-0aafcbf303fd tempest-AttachInterfacesV270Test-1816021839 tempest-AttachInterfacesV270Test-1816021839-project-member] Enqueued Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGHEST for action security_group_members [10210.905375] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGHEST for action security_group_members [10210.905666] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10210.905781] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10210.905845] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10210.906285] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10210.906501] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10210.906650] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10210.906811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10210.907032] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10210.907165] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10210.907292] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10211.104313] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f93f7997-4b3f-423d-a690-47bbfb3c31ee taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10211.104313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10211.108547] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8240f3ec-85dc-4104-b697-3ef975f60b42 with status ACTIVE [10211.109771] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10211.110087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10211.110250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10211.110645] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10211.111699] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10211.111699] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10211.111699] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10211.111699] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10211.112176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10211.112400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10211.112661] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10211.113229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10211.113229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10211.113229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10211.113508] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10211.113684] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8240f3ec-85dc-4104-b697-3ef975f60b42 is going to be updated. [10211.115304] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10211.139774] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10211.139926] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10211.139995] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10211.140257] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10211.140414] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10211.140579] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8240f3ec-85dc-4104-b697-3ef975f60b42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10211.410391] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10211.410391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10211.410391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10211.410391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10211.410391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10211.410811] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10211.410811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10211.410811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10211.410811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10211.410984] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10211.410984] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 is going to be updated. [10211.441379] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10211.443950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10211.443950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10211.443950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10211.443950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10211.453677] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 in Status: IN_PROGRESS for 2s [10211.618155] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10212.120700] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10212.120700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10212.120700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10212.120957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10212.120957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10212.120957] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee is going to be created. [10212.144180] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10212.144353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10212.144589] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10212.144589] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10212.144788] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10212.155087] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee in Status: UNINITIALIZED for 2s [10212.216443] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f47963db-7b78-435b-9e39-5f259f042bf4 in Status: IN_PROGRESS for 4s [10212.371429] env[65939]: INFO networking_nsxv3.common.synchronization [None req-db4e5b36-558d-4fb2-a9f1-e77c6029f7ac None None] Enqueued Resource ID: 1e4e2c8b-d224-4c48-a78b-547b549be6e1 with Priority: HIGHEST for action port [10212.371990] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4e2c8b-d224-4c48-a78b-547b549be6e1 with Priority: HIGHEST for action port [10212.373076] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e4e2c8b-d224-4c48-a78b-547b549be6e1 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10212.373076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e4e2c8b-d224-4c48-a78b-547b549be6e1" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10212.373076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e4e2c8b-d224-4c48-a78b-547b549be6e1" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10212.373076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e4e2c8b-d224-4c48-a78b-547b549be6e1" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10212.373076] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e4e2c8b-d224-4c48-a78b-547b549be6e1',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10212.876999] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e4e2c8b-d224-4c48-a78b-547b549be6e1 [10212.877316] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10212.879029] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10212.879029] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10212.879029] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10212.879029] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10212.879029] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e4e2c8b-d224-4c48-a78b-547b549be6e1 already deleted. [10212.879029] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e4e2c8b-d224-4c48-a78b-547b549be6e1" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10212.931160] env[65939]: INFO networking_nsxv3.common.synchronization [req-62c3b6e7-ee34-4a5a-ba54-9808949bf9d2 req-6548e698-b8b3-4b8b-9c05-add94cae2d76 tempest-ImagesOneServerTestJSON-118286224 tempest-ImagesOneServerTestJSON-118286224-project-member] Enqueued Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGHEST for action security_group_members [10212.931315] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGHEST for action security_group_members [10212.931700] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5444fe-a221-4357-9950-de3a392af0b6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10212.931876] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10212.932038] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10212.932409] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10212.932611] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10212.932796] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10212.932900] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10212.933240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10212.933410] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10212.933574] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10213.246862] env[65939]: INFO networking_nsxv3.common.synchronization [req-0a7b7c85-fe13-4b1d-bac6-d7ea85b00278 req-60af997c-45ea-4ac3-acb9-0073a36fef2f tempest-ServersWithSpecificFlavorTestJSON-1136329551 tempest-ServersWithSpecificFlavorTestJSON-1136329551-project-member] Enqueued Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_members [10213.247651] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGHEST for action security_group_members [10213.247964] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.248098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.248236] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.248449] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.248605] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.248762] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.248762] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.248902] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.248988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.249102] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10213.307816] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock network-263 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.308041] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "network-263" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.308280] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "network-263" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.308542] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "network-263" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.308806] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.308962] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.309088] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.309367] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.309524] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.309729] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10213.309967] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10213.309967] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10213.310081] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10213.310155] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10213.310258] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10213.310386] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [10213.335722] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10213.336011] env[65939]: DEBUG dogpile.cache.region [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10213.336252] env[65939]: DEBUG dogpile.lock [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10213.336532] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "network-263" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.337060] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.337493] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.337560] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.338019] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.338267] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10213.436694] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.436882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.436981] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.437162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.437259] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.437452] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.437574] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.437606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.437751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.437823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.437904] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5444fe-a221-4357-9950-de3a392af0b6 already deleted. [10213.437981] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.464472] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 in Status: SUCCESS [10213.464472] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 deletion is rescheduled due to dependency. [10213.464472] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.751852] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.753419] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.753553] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.753802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.753907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.754179] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.754333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.754333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.754541] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.754607] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.754676] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 is going to be updated. [10213.789436] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.789731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.789731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.790066] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.790185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.800314] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4415b353-eee7-421d-a222-35308d9d05b7 in Status: IN_PROGRESS for 2s [10213.840944] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.841313] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.841496] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.841836] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.842056] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.842229] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Segment Port a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813 not found, creating... [10213.842624] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.843263] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.843263] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.843263] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.843434] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.844249] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.844249] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.844397] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.844685] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.844844] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.845063] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Resource: SegmentPort with ID: a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813 is going to be created. [10213.865476] env[65939]: DEBUG networking_nsxv3.common.locking [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10213.865694] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10213.865824] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10213.866141] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10213.867014] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10213.867014] env[65939]: DEBUG oslo_concurrency.lockutils [None req-5954516f-adab-4e24-9c63-04116e60eff9 None None] Releasing lock "port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10214.169038] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee in Status: SUCCESS [10214.169038] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10214.169038] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10214.169629] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10214.169629] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10214.170208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10214.170208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10214.170208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10214.170208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10214.170552] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10214.171531] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10214.227589] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f47963db-7b78-435b-9e39-5f259f042bf4 in Status: SUCCESS [10214.227733] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f47963db-7b78-435b-9e39-5f259f042bf4 deletion is rescheduled due to dependency. [10214.227833] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10214.596694] env[65939]: INFO networking_nsxv3.common.synchronization [req-62c3b6e7-ee34-4a5a-ba54-9808949bf9d2 req-0f5f1952-ddc3-4c74-8a0c-a93022ca4434 service nova] Enqueued Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGHEST for action security_group_rules [10214.596939] env[65939]: INFO networking_nsxv3.common.synchronization [req-62c3b6e7-ee34-4a5a-ba54-9808949bf9d2 req-0f5f1952-ddc3-4c74-8a0c-a93022ca4434 service nova] Enqueued Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGHEST for action security_group_members [10214.597100] env[65939]: INFO networking_nsxv3.common.synchronization [req-62c3b6e7-ee34-4a5a-ba54-9808949bf9d2 req-0f5f1952-ddc3-4c74-8a0c-a93022ca4434 service nova] Enqueued Resource ID: a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813 with Priority: HIGHEST for action port [10214.597987] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGHEST for action security_group_rules [10214.598409] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGHEST for action security_group_members [10214.598409] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813 with Priority: HIGHEST for action port [10214.598596] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5444fe-a221-4357-9950-de3a392af0b6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10214.598723] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10214.598788] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10214.599125] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10214.599125] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10214.600077] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5444fe-a221-4357-9950-de3a392af0b6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10214.600197] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10214.600264] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10214.600587] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10214.602773] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10214.602773] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10214.602773] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10214.602944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10214.602944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10214.603260] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10214.603885] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10214.603983] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10214.604068] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10214.605332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10214.605332] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10214.673707] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10215.089709] env[65939]: INFO networking_nsxv3.common.synchronization [None req-9527079e-b659-4c31-8b71-fe450131c41d None None] Enqueued Resource ID: c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481 with Priority: HIGHEST for action port [10215.090906] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481 with Priority: HIGHEST for action port [10215.091585] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.091726] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.091800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10215.092032] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10215.092116] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10215.106698] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5444fe-a221-4357-9950-de3a392af0b6 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.106698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.106698] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10215.108503] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813 with status ACTIVE [10215.108503] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.108624] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.108624] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10215.108775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10215.108906] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.110091] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.110263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.110344] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10215.110588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10215.110643] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.110814] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.110907] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.110968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10215.111133] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10215.111210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.111297] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813 is going to be updated. [10215.136365] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.136526] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.136587] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10215.136776] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10215.136914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.137084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a39bd8e8-5ec0-4fed-87a8-fd63bdbb7813" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.177300] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f93f7997-4b3f-423d-a690-47bbfb3c31ee: rpc.has_security_group_logging(os_id): False [10215.197420] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.197420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.197420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10215.197420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10215.197420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.200277] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.200450] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.200531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10215.200755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10215.200929] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.201055] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee is going to be created. [10215.281046] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.282456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.282456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10215.282456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10215.282456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.470376] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee in Status: IN_PROGRESS for 2s [10215.597698] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481 [10215.598067] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10215.598230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10215.598322] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10215.598523] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10215.598612] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.598817] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481 already deleted. [10215.598817] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3f3a6e8-99fb-4b59-a873-cdd2fb2cf481" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10215.610062] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10215.812486] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4415b353-eee7-421d-a222-35308d9d05b7 in Status: SUCCESS [10215.812486] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 deletion is rescheduled due to dependency. [10215.812486] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10216.113063] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10216.113063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10216.113063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10216.113600] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10216.113600] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10216.113600] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5444fe-a221-4357-9950-de3a392af0b6 is going to be created. [10216.139025] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10216.139143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10216.139210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10216.139424] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10216.139578] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10216.149908] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5444fe-a221-4357-9950-de3a392af0b6 in Status: UNINITIALIZED for 2s [10217.483903] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee in Status: SUCCESS [10217.484164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10217.747753] env[65939]: INFO networking_nsxv3.common.synchronization [req-f2355b51-56ff-4611-ae88-2b272f96968c req-ee37b368-2d1e-46e2-94b7-242f85a87a88 tempest-ServerDiskConfigTestJSON-1925570613 tempest-ServerDiskConfigTestJSON-1925570613-project-member] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10217.748358] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGHEST for action security_group_members [10217.748662] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10217.748793] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10217.748857] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10217.749183] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10217.749344] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10217.749442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10217.749571] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10217.749671] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10217.749754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10217.749844] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10218.118029] env[65939]: INFO networking_nsxv3.common.synchronization [req-fa07c3d3-3544-419a-ad72-e028f259a9fc req-9b97c1c2-dc79-4a82-b50d-be28949d6e40 tempest-ServersAdminNegativeTestJSON-58030456 tempest-ServersAdminNegativeTestJSON-58030456-project-member] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10218.118673] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGHEST for action security_group_members [10218.118987] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.120139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.120215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.120437] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.120654] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.120829] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.120829] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.120972] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.121080] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.121175] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10218.160796] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5444fe-a221-4357-9950-de3a392af0b6 in Status: SUCCESS [10218.161056] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.161244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.161469] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.161668] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.161775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.161836] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.161988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.162083] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.162186] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.162257] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10218.252010] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.252113] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.252155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.252438] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.252541] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.252831] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.252997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.253143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.254827] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.254827] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.254827] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be updated. [10218.284586] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.284774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.284848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.285083] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.285232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.293874] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: IN_PROGRESS for 2s [10218.623661] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.623914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.623914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.624136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.627416] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.627682] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.627800] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.627867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.628056] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.628235] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.628332] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be updated. [10218.660475] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.660475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.660475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.660475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.660475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.665840] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5444fe-a221-4357-9950-de3a392af0b6 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.666014] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.666081] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.666463] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.666463] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.666592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.666592] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.666750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.666839] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.666925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.667085] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5444fe-a221-4357-9950-de3a392af0b6 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.667175] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.667231] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.667413] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.667992] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10218.667992] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10218.667992] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10218.667992] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10218.667992] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.667992] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10218.668313] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10218.671953] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: IN_PROGRESS for 2s [10219.172100] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e5444fe-a221-4357-9950-de3a392af0b6: rpc.has_security_group_logging(os_id): False [10219.189963] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10219.189963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10219.189963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10219.189963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10219.189963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10219.190173] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10219.191030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10219.191030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10219.191221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10219.191324] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10219.192097] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10219.192097] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10219.192097] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10219.192097] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10219.192097] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10219.192097] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10219.192549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10219.192549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10219.192549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10219.192549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10219.192549] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5444fe-a221-4357-9950-de3a392af0b6 is going to be created. [10219.253293] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10219.253293] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10219.253293] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10219.253293] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10219.253758] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10219.269044] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5444fe-a221-4357-9950-de3a392af0b6 in Status: IN_PROGRESS for 2s [10220.304270] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 in Status: SUCCESS [10220.304669] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 deletion is rescheduled due to dependency. [10220.304669] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10220.684646] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 in Status: SUCCESS [10220.685177] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 deletion is rescheduled due to dependency. [10220.685476] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10221.282423] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5444fe-a221-4357-9950-de3a392af0b6 in Status: SUCCESS [10221.282727] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10221.545510] env[65939]: INFO networking_nsxv3.common.synchronization [None req-f479bb34-3ecc-4bf9-8fc0-a2cc6b893019 None None] Enqueued Resource ID: f6a86252-b7fa-481a-a858-cee14709841b with Priority: HIGHEST for action port [10221.545761] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6a86252-b7fa-481a-a858-cee14709841b with Priority: HIGHEST for action port [10221.545941] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6a86252-b7fa-481a-a858-cee14709841b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10221.548193] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6a86252-b7fa-481a-a858-cee14709841b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10221.548193] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6a86252-b7fa-481a-a858-cee14709841b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10221.548193] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6a86252-b7fa-481a-a858-cee14709841b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10221.548193] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6a86252-b7fa-481a-a858-cee14709841b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10222.051117] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6a86252-b7fa-481a-a858-cee14709841b [10222.051117] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10222.051117] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10222.051117] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10222.051117] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10222.051117] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10222.051414] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6a86252-b7fa-481a-a858-cee14709841b already deleted. [10222.051414] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6a86252-b7fa-481a-a858-cee14709841b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10222.063259] env[65939]: INFO networking_nsxv3.common.synchronization [None req-dadbe922-53b5-451f-aae4-cf89f6614253 tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: 360d8215-aedf-42ed-986b-57dc1a0c661f with Priority: HIGHEST for action security_group_rules [10222.064722] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 360d8215-aedf-42ed-986b-57dc1a0c661f with Priority: HIGHEST for action security_group_rules [10222.065617] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-360d8215-aedf-42ed-986b-57dc1a0c661f taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10222.065617] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-360d8215-aedf-42ed-986b-57dc1a0c661f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10222.065617] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-360d8215-aedf-42ed-986b-57dc1a0c661f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10222.065617] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-360d8215-aedf-42ed-986b-57dc1a0c661f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10222.065617] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('360d8215-aedf-42ed-986b-57dc1a0c661f',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10222.159199] env[65939]: INFO networking_nsxv3.common.synchronization [None req-05e872e4-7d05-4cdb-b2f6-e58743c5dcb5 tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: 360d8215-aedf-42ed-986b-57dc1a0c661f with Priority: HIGHEST for action security_group_rules [10222.163711] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 360d8215-aedf-42ed-986b-57dc1a0c661f with Priority: HIGHEST for action security_group_rules [10222.163711] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-360d8215-aedf-42ed-986b-57dc1a0c661f taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10222.163711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-360d8215-aedf-42ed-986b-57dc1a0c661f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10222.589390] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10222.589796] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10222.589796] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10222.589892] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10222.589975] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10222.590094] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 360d8215-aedf-42ed-986b-57dc1a0c661f already deleted. [10222.590181] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-360d8215-aedf-42ed-986b-57dc1a0c661f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10222.590349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-360d8215-aedf-42ed-986b-57dc1a0c661f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10222.590588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-360d8215-aedf-42ed-986b-57dc1a0c661f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10222.590696] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('360d8215-aedf-42ed-986b-57dc1a0c661f',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10222.630184] env[65939]: INFO networking_nsxv3.common.synchronization [None req-2eba8565-fdbb-4d9f-957e-ae277ae77ef1 tempest-ServersTestFqdnHostnames-1646320837 tempest-ServersTestFqdnHostnames-1646320837-project-member] Enqueued Resource ID: cd5b58d5-7279-4c61-9d3e-2148b88d3884 with Priority: HIGHEST for action security_group_rules [10222.630705] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b58d5-7279-4c61-9d3e-2148b88d3884 with Priority: HIGHEST for action security_group_rules [10222.631330] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10222.631330] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10222.631330] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10222.632708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10222.632708] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd5b58d5-7279-4c61-9d3e-2148b88d3884',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10222.769322] env[65939]: INFO networking_nsxv3.common.synchronization [None req-605563af-c21a-4011-b6d2-e417464ebc23 tempest-ServersTestFqdnHostnames-1646320837 tempest-ServersTestFqdnHostnames-1646320837-project-member] Enqueued Resource ID: cd5b58d5-7279-4c61-9d3e-2148b88d3884 with Priority: HIGHEST for action security_group_rules [10222.769973] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5b58d5-7279-4c61-9d3e-2148b88d3884 with Priority: HIGHEST for action security_group_rules [10222.770398] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10222.770512] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10223.112492] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10223.112652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10223.112708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10223.112929] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10223.113030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10223.113128] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 360d8215-aedf-42ed-986b-57dc1a0c661f already deleted. [10223.113220] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-360d8215-aedf-42ed-986b-57dc1a0c661f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10223.151157] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10223.151303] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10223.151374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10223.151588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10223.151684] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10223.151770] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd5b58d5-7279-4c61-9d3e-2148b88d3884 already deleted. [10223.151864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10223.152009] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10223.152166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10223.152248] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd5b58d5-7279-4c61-9d3e-2148b88d3884',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10223.674918] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10223.675253] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10223.675253] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10223.676215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10223.676215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10223.676215] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd5b58d5-7279-4c61-9d3e-2148b88d3884 already deleted. [10223.676215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd5b58d5-7279-4c61-9d3e-2148b88d3884" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10224.065310] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ced1bc8f-a617-4f93-b57a-a67d1f2f46b6 None None] Enqueued Resource ID: 39343a86-c4fc-4fb8-a833-bb921e9aa0fd with Priority: HIGHEST for action port [10224.068020] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39343a86-c4fc-4fb8-a833-bb921e9aa0fd with Priority: HIGHEST for action port [10224.068020] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-39343a86-c4fc-4fb8-a833-bb921e9aa0fd taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10224.068020] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39343a86-c4fc-4fb8-a833-bb921e9aa0fd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10224.068020] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39343a86-c4fc-4fb8-a833-bb921e9aa0fd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10224.068020] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39343a86-c4fc-4fb8-a833-bb921e9aa0fd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10224.068020] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39343a86-c4fc-4fb8-a833-bb921e9aa0fd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10224.572333] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39343a86-c4fc-4fb8-a833-bb921e9aa0fd [10224.572333] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10224.572333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10224.572333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10224.572333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10224.572333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10224.572333] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39343a86-c4fc-4fb8-a833-bb921e9aa0fd already deleted. [10224.572333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39343a86-c4fc-4fb8-a833-bb921e9aa0fd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10228.729480] env[65939]: INFO networking_nsxv3.common.synchronization [None req-40dda0c7-9b03-4789-a510-6a7d3aefc030 None None] Enqueued Resource ID: 11b89c79-6c57-49cc-aca7-cbefa4101288 with Priority: HIGHEST for action port [10228.730873] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11b89c79-6c57-49cc-aca7-cbefa4101288 with Priority: HIGHEST for action port [10228.731705] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-11b89c79-6c57-49cc-aca7-cbefa4101288 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10228.731853] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11b89c79-6c57-49cc-aca7-cbefa4101288" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10228.731853] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11b89c79-6c57-49cc-aca7-cbefa4101288" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10228.732383] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11b89c79-6c57-49cc-aca7-cbefa4101288" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10228.732525] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11b89c79-6c57-49cc-aca7-cbefa4101288',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10229.235702] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11b89c79-6c57-49cc-aca7-cbefa4101288 [10229.235702] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10229.235702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10229.235986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10229.236034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10229.236195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10229.236287] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11b89c79-6c57-49cc-aca7-cbefa4101288 already deleted. [10229.236330] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11b89c79-6c57-49cc-aca7-cbefa4101288" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10230.701732] env[65939]: INFO networking_nsxv3.common.synchronization [None req-94b42084-5712-4853-9f89-36cecf4ec637 None None] Enqueued Resource ID: 12f02024-5292-43d4-88a4-e5914545970a with Priority: HIGHEST for action port [10230.702332] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f02024-5292-43d4-88a4-e5914545970a with Priority: HIGHEST for action port [10230.702638] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-12f02024-5292-43d4-88a4-e5914545970a taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10230.702757] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12f02024-5292-43d4-88a4-e5914545970a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10230.702823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12f02024-5292-43d4-88a4-e5914545970a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10230.703525] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12f02024-5292-43d4-88a4-e5914545970a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10230.703618] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12f02024-5292-43d4-88a4-e5914545970a',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10231.206433] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12f02024-5292-43d4-88a4-e5914545970a [10231.206703] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10231.206868] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10231.206948] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10231.207204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10231.207316] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10231.207414] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12f02024-5292-43d4-88a4-e5914545970a already deleted. [10231.207498] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12f02024-5292-43d4-88a4-e5914545970a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10235.703055] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10235.703235] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10240.704369] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10240.705198] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10241.551782] env[65939]: INFO networking_nsxv3.common.synchronization [None req-64acf0d6-fbb9-4a7a-85b8-d64d85d084c2 None None] Enqueued Resource ID: d1e734f1-29cd-408f-ac22-a4ef2e27d0b4 with Priority: HIGHEST for action port [10241.551782] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1e734f1-29cd-408f-ac22-a4ef2e27d0b4 with Priority: HIGHEST for action port [10241.551782] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1e734f1-29cd-408f-ac22-a4ef2e27d0b4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10241.551782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1e734f1-29cd-408f-ac22-a4ef2e27d0b4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10241.551782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1e734f1-29cd-408f-ac22-a4ef2e27d0b4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10241.551782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1e734f1-29cd-408f-ac22-a4ef2e27d0b4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10241.551782] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e734f1-29cd-408f-ac22-a4ef2e27d0b4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10242.057147] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1e734f1-29cd-408f-ac22-a4ef2e27d0b4 [10242.057147] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10242.057147] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10242.057147] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10242.057147] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10242.057681] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10242.057681] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1e734f1-29cd-408f-ac22-a4ef2e27d0b4 already deleted. [10242.057681] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1e734f1-29cd-408f-ac22-a4ef2e27d0b4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10246.190875] env[65939]: INFO networking_nsxv3.common.synchronization [None req-76916165-681d-4bcb-ae43-342ff82e4e5f None None] Enqueued Resource ID: c5677c43-9748-45cf-aaad-d55115323754 with Priority: HIGHEST for action port [10246.191462] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5677c43-9748-45cf-aaad-d55115323754 with Priority: HIGHEST for action port [10246.192143] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5677c43-9748-45cf-aaad-d55115323754 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10246.192143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5677c43-9748-45cf-aaad-d55115323754" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10246.192143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5677c43-9748-45cf-aaad-d55115323754" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10246.195340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5677c43-9748-45cf-aaad-d55115323754" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10246.195448] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5677c43-9748-45cf-aaad-d55115323754',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10246.701326] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5677c43-9748-45cf-aaad-d55115323754 [10246.701504] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10246.701675] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10246.701741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10246.702023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10246.702023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10246.702116] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5677c43-9748-45cf-aaad-d55115323754 already deleted. [10246.702194] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5677c43-9748-45cf-aaad-d55115323754" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10247.156022] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ba3a29d6-0ec9-4f34-a321-ee555b0547ba tempest-ServersV294TestFqdnHostnames-34926749 tempest-ServersV294TestFqdnHostnames-34926749-project-member] Enqueued Resource ID: 37b5cbd2-5be8-45e7-aaa7-c7988aa9670e with Priority: HIGHEST for action security_group_rules [10247.156022] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b5cbd2-5be8-45e7-aaa7-c7988aa9670e with Priority: HIGHEST for action security_group_rules [10247.156022] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10247.156022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10247.156022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10247.156022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10247.156022] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b5cbd2-5be8-45e7-aaa7-c7988aa9670e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10247.299464] env[65939]: INFO networking_nsxv3.common.synchronization [None req-d5c74b99-3f23-41cf-8315-7399da12a100 tempest-ServersV294TestFqdnHostnames-34926749 tempest-ServersV294TestFqdnHostnames-34926749-project-member] Enqueued Resource ID: 37b5cbd2-5be8-45e7-aaa7-c7988aa9670e with Priority: HIGHEST for action security_group_rules [10247.299464] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b5cbd2-5be8-45e7-aaa7-c7988aa9670e with Priority: HIGHEST for action security_group_rules [10247.299464] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10247.299464] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10247.679463] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10247.679667] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10247.679667] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10247.679997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10247.679997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10247.680115] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b5cbd2-5be8-45e7-aaa7-c7988aa9670e already deleted. [10247.680199] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10247.680367] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10247.680601] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10247.680601] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b5cbd2-5be8-45e7-aaa7-c7988aa9670e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10248.206573] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10248.206573] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10248.207086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10248.207360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10248.207360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10248.207512] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b5cbd2-5be8-45e7-aaa7-c7988aa9670e already deleted. [10248.207558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b5cbd2-5be8-45e7-aaa7-c7988aa9670e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10248.731298] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ed2c7bf0-f25a-46db-85ab-0da36db8af96 None None] Enqueued Resource ID: 63c038c1-9b7d-49fb-8534-752dd1b5eb42 with Priority: HIGHEST for action port [10248.731871] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c038c1-9b7d-49fb-8534-752dd1b5eb42 with Priority: HIGHEST for action port [10248.732217] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-63c038c1-9b7d-49fb-8534-752dd1b5eb42 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10248.732340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63c038c1-9b7d-49fb-8534-752dd1b5eb42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10248.732407] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63c038c1-9b7d-49fb-8534-752dd1b5eb42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10248.732670] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63c038c1-9b7d-49fb-8534-752dd1b5eb42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10248.732756] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63c038c1-9b7d-49fb-8534-752dd1b5eb42',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10249.235056] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63c038c1-9b7d-49fb-8534-752dd1b5eb42 [10249.236046] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10249.236046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10249.236046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10249.236046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10249.236046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10249.236046] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63c038c1-9b7d-49fb-8534-752dd1b5eb42 already deleted. [10249.236046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63c038c1-9b7d-49fb-8534-752dd1b5eb42" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10250.820611] env[65939]: INFO networking_nsxv3.common.synchronization [req-ceb39b33-14d7-4b97-968b-1b4b75ecd95c req-a061d2bb-71b0-4543-aaad-94bfe83fa04c tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGHEST for action security_group_members [10250.821247] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGHEST for action security_group_members [10250.821694] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-71daec27-b0f6-4e1c-818d-ad3a56644326 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10250.821911] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10250.822010] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10250.822402] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10250.822617] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10250.822745] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10250.822812] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10250.823149] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10250.823249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10250.823340] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10251.131243] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10251.131439] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "network-509" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10251.131561] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "network-509" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10251.131815] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "network-509" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10251.132431] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10251.132601] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10251.132718] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10251.132932] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10251.133090] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10251.133291] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10251.133400] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] NeedRegenerationException {{(pid=65939) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [10251.133507] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] no value, waiting for create lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [10251.133614] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] value creation lock acquired {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [10251.133721] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] No value present for key: 'zone-id' {{(pid=65939) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [10251.133821] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Calling creation function for not-yet-present value {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [10251.133948] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Looking for TransportZone with name nsx-vlan-transportzone. [10251.156267] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [10251.156509] env[65939]: DEBUG dogpile.cache.region [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65939) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [10251.156685] env[65939]: DEBUG dogpile.lock [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Released creation lock {{(pid=65939) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [10251.156865] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "network-509" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10251.157186] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9 taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10251.157357] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10251.157473] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10251.157818] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10251.157994] env[65939]: DEBUG networking_nsxv3.api.rpc [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d9c4f78-6f1e-4457-850d-a82079c0f1f9',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10251.328756] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10251.328938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10251.329016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10251.329223] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10251.329313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10251.329695] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10251.329695] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10251.329910] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10251.329968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10251.330059] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10251.330155] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 already deleted. [10251.330240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10251.660792] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10251.661026] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10251.661151] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10251.661440] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10251.661594] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10251.661751] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Segment Port 5d9c4f78-6f1e-4457-850d-a82079c0f1f9 not found, creating... [10251.662009] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10251.662175] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10251.662286] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10251.662493] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10251.662621] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10251.662896] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10251.663058] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10251.663174] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10251.663374] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10251.663494] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10251.663628] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Resource: SegmentPort with ID: 5d9c4f78-6f1e-4457-850d-a82079c0f1f9 is going to be created. [10251.684375] env[65939]: DEBUG networking_nsxv3.common.locking [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10251.684591] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10251.684714] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10251.684994] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10251.685263] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10251.685501] env[65939]: DEBUG oslo_concurrency.lockutils [None req-4bb6c9aa-74b2-4b5e-9b1b-f12a4005202a None None] Releasing lock "port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10252.374884] env[65939]: INFO networking_nsxv3.common.synchronization [req-ceb39b33-14d7-4b97-968b-1b4b75ecd95c req-76ab5814-6da5-4f87-8ba6-6856bae70cb7 service nova] Enqueued Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGHEST for action security_group_rules [10252.375156] env[65939]: INFO networking_nsxv3.common.synchronization [req-ceb39b33-14d7-4b97-968b-1b4b75ecd95c req-76ab5814-6da5-4f87-8ba6-6856bae70cb7 service nova] Enqueued Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGHEST for action security_group_members [10252.375205] env[65939]: INFO networking_nsxv3.common.synchronization [req-ceb39b33-14d7-4b97-968b-1b4b75ecd95c req-76ab5814-6da5-4f87-8ba6-6856bae70cb7 service nova] Enqueued Resource ID: 5d9c4f78-6f1e-4457-850d-a82079c0f1f9 with Priority: HIGHEST for action port [10252.375730] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGHEST for action security_group_rules [10252.375889] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGHEST for action security_group_members [10252.375969] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9c4f78-6f1e-4457-850d-a82079c0f1f9 with Priority: HIGHEST for action port [10252.376245] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71daec27-b0f6-4e1c-818d-ad3a56644326 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10252.376339] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10252.376423] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10252.376705] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10252.376773] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10252.377632] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-71daec27-b0f6-4e1c-818d-ad3a56644326 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10252.377753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10252.377816] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10252.377980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10252.378137] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10252.379035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10252.379035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10252.379035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10252.379035] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10252.379035] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10252.379884] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10252.379884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10252.379884] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10252.380372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10252.380372] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d9c4f78-6f1e-4457-850d-a82079c0f1f9',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10252.882324] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-71daec27-b0f6-4e1c-818d-ad3a56644326 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10252.882561] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10252.882615] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10252.883482] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d9c4f78-6f1e-4457-850d-a82079c0f1f9 with status ACTIVE [10252.883678] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10252.883784] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10252.883843] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10252.884062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10252.884152] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10252.884325] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10252.884415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10252.884478] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10252.884615] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10252.884693] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10252.884895] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10252.885030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10252.885030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10252.885170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10252.885232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10252.885317] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d9c4f78-6f1e-4457-850d-a82079c0f1f9 is going to be updated. [10252.909877] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10252.910060] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10252.910129] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10252.910316] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10252.910446] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10252.910601] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d9c4f78-6f1e-4457-850d-a82079c0f1f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10253.388135] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10253.891409] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10253.891615] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10253.891687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10253.891965] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10253.892095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10253.892201] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 is going to be created. [10253.920039] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10253.920039] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10253.920039] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10253.920039] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10253.920039] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10253.931118] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 in Status: UNINITIALIZED for 2s [10255.943588] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 in Status: SUCCESS [10255.943588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10255.943588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10255.944181] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10255.944181] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10255.944181] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10255.944181] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10255.944338] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10255.944428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10255.944528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10255.944645] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10256.448253] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-71daec27-b0f6-4e1c-818d-ad3a56644326 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10256.448253] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10256.448444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10256.448560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10256.449417] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10256.449618] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10256.449748] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10256.449885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10256.450059] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10256.450111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10256.450242] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-71daec27-b0f6-4e1c-818d-ad3a56644326 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10256.450362] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10256.450438] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10256.450564] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10256.450789] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10256.450938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10256.450999] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10256.451181] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10256.451267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10256.451385] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10256.451450] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10256.954236] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71daec27-b0f6-4e1c-818d-ad3a56644326: rpc.has_security_group_logging(os_id): False [10256.972406] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10256.972591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10256.972641] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10256.972821] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10256.972909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10256.973133] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10256.973233] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10256.973297] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10256.973443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10256.973517] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10256.973691] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10256.973782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10256.973839] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10256.973970] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10256.974055] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10256.974224] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10256.974311] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10256.974370] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10256.974501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10256.974571] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10256.974655] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 is going to be created. [10257.036203] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10257.036349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10257.036412] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10257.036666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10257.036842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10257.047747] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 in Status: IN_PROGRESS for 2s [10257.377231] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10257.377372] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [10259.062175] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 in Status: SUCCESS [10259.062457] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10260.071567] env[65939]: INFO networking_nsxv3.common.synchronization [req-fe6521c3-dcc2-4b0c-8cfa-ada03f2c721c req-df4774e5-1b43-40c0-846c-aa3656fba5bb tempest-ImagesOneServerTestJSON-118286224 tempest-ImagesOneServerTestJSON-118286224-project-member] Enqueued Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGHEST for action security_group_members [10260.071567] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGHEST for action security_group_members [10260.071941] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5444fe-a221-4357-9950-de3a392af0b6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10260.071941] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10260.071941] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10260.072721] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10260.072890] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10260.073111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10260.073111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10260.073242] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10260.073327] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10260.073421] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10260.575054] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10260.575223] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10260.575294] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10260.575505] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10260.575598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10260.575791] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10260.575889] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10260.575951] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10260.576120] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10260.576193] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10260.576279] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5444fe-a221-4357-9950-de3a392af0b6 is going to be updated. [10260.610193] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10260.610390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10260.610426] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10260.610811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10260.610811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10260.631139] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5444fe-a221-4357-9950-de3a392af0b6 in Status: IN_PROGRESS for 2s [10262.644632] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5444fe-a221-4357-9950-de3a392af0b6 in Status: SUCCESS [10262.645044] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5444fe-a221-4357-9950-de3a392af0b6 deletion is rescheduled due to dependency. [10262.645044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10265.072385] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10265.072666] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10265.365584] env[65939]: INFO networking_nsxv3.common.synchronization [req-b34a53b9-b947-4891-a528-1507d57c4139 req-3a72b382-eed1-440a-9f47-5c1bbc5fc7aa tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGHEST for action security_group_members [10265.366388] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGHEST for action security_group_members [10265.367191] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-71daec27-b0f6-4e1c-818d-ad3a56644326 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10265.367301] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10265.367301] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10265.367481] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10265.367628] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10265.367719] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10265.367775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10265.367914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10265.367998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10265.368102] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10265.870590] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10265.871289] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10265.871561] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10265.872234] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10265.872444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10265.872772] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10265.873287] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10265.873466] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10265.875301] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10265.875301] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10265.875301] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 is going to be updated. [10265.903197] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10265.903647] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10265.903647] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10265.903647] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10265.903778] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10265.917350] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 in Status: IN_PROGRESS for 2s [10267.929149] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 in Status: SUCCESS [10267.929523] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 deletion is rescheduled due to dependency. [10267.929523] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10268.615662] env[65939]: INFO networking_nsxv3.common.synchronization [req-ec732aa2-1186-43a3-9150-f0b33f34dd5d req-d638a1f8-702c-4bee-a5ee-be555fb72996 tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_members [10268.616486] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGHEST for action security_group_members [10268.617148] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-152e138c-a16f-4ab1-ae1d-27177515f5d0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10268.617148] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10268.617148] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10268.617384] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10268.617561] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10268.618074] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10268.618074] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10268.618074] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10268.618074] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10268.618074] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10269.120158] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10269.120455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10269.120455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10269.120917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10269.120917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10269.121728] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10269.121728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10269.121728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10269.121728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10269.121728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10269.121728] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 is going to be updated. [10269.154170] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10269.154170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10269.154170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10269.154170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10269.154410] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10269.164328] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 in Status: IN_PROGRESS for 2s [10269.266023] env[65939]: INFO networking_nsxv3.common.synchronization [None req-10ac7c56-d17b-4a43-b8c9-882d40a768a5 None None] Enqueued Resource ID: ea3cb715-a9d1-40f8-97fe-4876a870a7f7 with Priority: HIGHEST for action port [10269.266564] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3cb715-a9d1-40f8-97fe-4876a870a7f7 with Priority: HIGHEST for action port [10269.267062] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea3cb715-a9d1-40f8-97fe-4876a870a7f7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10269.267062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea3cb715-a9d1-40f8-97fe-4876a870a7f7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10269.267218] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea3cb715-a9d1-40f8-97fe-4876a870a7f7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10269.267343] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea3cb715-a9d1-40f8-97fe-4876a870a7f7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10269.267426] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3cb715-a9d1-40f8-97fe-4876a870a7f7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10269.769996] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea3cb715-a9d1-40f8-97fe-4876a870a7f7 [10269.770300] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10269.770435] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10269.770501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10269.770713] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10269.770801] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10269.770904] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea3cb715-a9d1-40f8-97fe-4876a870a7f7 already deleted. [10269.770985] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea3cb715-a9d1-40f8-97fe-4876a870a7f7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10271.175014] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 in Status: SUCCESS [10271.175357] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 deletion is rescheduled due to dependency. [10271.175357] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10271.617423] env[65939]: INFO networking_nsxv3.common.synchronization [None req-983e425b-d50d-487d-9308-59265d8f8e14 None None] Enqueued Resource ID: ebf081b5-2fcb-4dde-a0ba-e1b8b8275452 with Priority: HIGHEST for action port [10271.618360] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf081b5-2fcb-4dde-a0ba-e1b8b8275452 with Priority: HIGHEST for action port [10271.618806] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebf081b5-2fcb-4dde-a0ba-e1b8b8275452 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10271.618806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebf081b5-2fcb-4dde-a0ba-e1b8b8275452" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10271.618954] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebf081b5-2fcb-4dde-a0ba-e1b8b8275452" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10271.619141] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebf081b5-2fcb-4dde-a0ba-e1b8b8275452" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10271.619221] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebf081b5-2fcb-4dde-a0ba-e1b8b8275452',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10272.121692] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebf081b5-2fcb-4dde-a0ba-e1b8b8275452 [10272.121692] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10272.121850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10272.121850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10272.122079] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10272.122252] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10272.122303] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebf081b5-2fcb-4dde-a0ba-e1b8b8275452 already deleted. [10272.122337] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebf081b5-2fcb-4dde-a0ba-e1b8b8275452" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10276.619364] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10276.619661] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10281.620492] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10281.620763] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10282.437205] env[65939]: INFO networking_nsxv3.common.synchronization [None req-dae920e4-8e5c-4469-8ecb-842128e3d64c tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 16dff4ea-5645-438c-bed7-b4f681d74808 with Priority: HIGHEST for action security_group_rules [10282.437552] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16dff4ea-5645-438c-bed7-b4f681d74808 with Priority: HIGHEST for action security_group_rules [10282.437635] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16dff4ea-5645-438c-bed7-b4f681d74808 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10282.437750] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16dff4ea-5645-438c-bed7-b4f681d74808" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10282.437813] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16dff4ea-5645-438c-bed7-b4f681d74808" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10282.438068] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16dff4ea-5645-438c-bed7-b4f681d74808" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10282.438156] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16dff4ea-5645-438c-bed7-b4f681d74808',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10282.516142] env[65939]: INFO networking_nsxv3.common.synchronization [None req-980f55e9-d89f-4af7-89b3-cfc640ebeb42 tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 16dff4ea-5645-438c-bed7-b4f681d74808 with Priority: HIGHEST for action security_group_rules [10282.516808] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16dff4ea-5645-438c-bed7-b4f681d74808 with Priority: HIGHEST for action security_group_rules [10282.517182] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16dff4ea-5645-438c-bed7-b4f681d74808 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10282.517289] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16dff4ea-5645-438c-bed7-b4f681d74808" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10282.963126] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10282.963466] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10282.963466] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10282.963553] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10282.964814] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10282.964814] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16dff4ea-5645-438c-bed7-b4f681d74808 already deleted. [10282.964814] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16dff4ea-5645-438c-bed7-b4f681d74808" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10282.964814] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16dff4ea-5645-438c-bed7-b4f681d74808" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10282.964814] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16dff4ea-5645-438c-bed7-b4f681d74808" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10282.964814] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16dff4ea-5645-438c-bed7-b4f681d74808',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10283.485602] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10283.485824] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10283.485930] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10283.486242] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10283.486345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10283.486468] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16dff4ea-5645-438c-bed7-b4f681d74808 already deleted. [10283.486523] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16dff4ea-5645-438c-bed7-b4f681d74808" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10287.518584] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10287.518584] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10292.519770] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10292.520090] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10297.521522] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10297.521822] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10302.522718] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10302.522718] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10307.524095] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10307.524376] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10312.525311] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10312.525641] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10314.380498] env[65939]: INFO networking_nsxv3.common.synchronization [req-8d6081aa-6863-43ce-8842-6a70648f82ef req-5e8ba54a-1f03-4701-a2aa-47f471ef530a tempest-VolumesAssistedSnapshotsTest-1278773564 tempest-VolumesAssistedSnapshotsTest-1278773564-project-member] Enqueued Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_members [10314.381467] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGHEST for action security_group_members [10314.381467] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10314.381467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10314.381681] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10314.381802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10314.381976] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10314.382090] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10314.382152] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10314.382305] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10314.382399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10314.382477] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10314.885125] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10314.885290] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10314.885358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10314.885594] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10314.885687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10314.885910] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10314.886153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10314.886153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10314.886244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10314.886320] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10314.886448] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 is going to be updated. [10314.916930] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10314.917146] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10314.917191] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10314.917396] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10314.917550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10314.927691] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 in Status: IN_PROGRESS for 2s [10316.939296] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 in Status: SUCCESS [10316.939583] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 deletion is rescheduled due to dependency. [10316.939583] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10319.382734] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10319.382974] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10324.383794] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10324.384051] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10328.304202] env[65939]: INFO networking_nsxv3.common.synchronization [None req-7002b581-2348-4d27-99ef-75a8f335aaaf None None] Enqueued Resource ID: b695483d-984b-41cd-9de1-12328e6cd3d6 with Priority: HIGHEST for action port [10328.304756] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b695483d-984b-41cd-9de1-12328e6cd3d6 with Priority: HIGHEST for action port [10328.305110] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-b695483d-984b-41cd-9de1-12328e6cd3d6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10328.305230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b695483d-984b-41cd-9de1-12328e6cd3d6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10328.305294] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b695483d-984b-41cd-9de1-12328e6cd3d6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10328.305564] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b695483d-984b-41cd-9de1-12328e6cd3d6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10328.305644] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b695483d-984b-41cd-9de1-12328e6cd3d6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10328.811917] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b695483d-984b-41cd-9de1-12328e6cd3d6 [10328.812134] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10328.812334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10328.812334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10328.812699] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10328.813631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10328.813631] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b695483d-984b-41cd-9de1-12328e6cd3d6 already deleted. [10328.813631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b695483d-984b-41cd-9de1-12328e6cd3d6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10330.765827] env[65939]: INFO networking_nsxv3.common.synchronization [None req-e59d4a0f-8aaa-4e7b-91aa-868c92d54db7 None None] Enqueued Resource ID: c0dc89eb-360c-48ae-aabe-cc01caf99a85 with Priority: HIGHEST for action port [10330.766212] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0dc89eb-360c-48ae-aabe-cc01caf99a85 with Priority: HIGHEST for action port [10330.766527] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0dc89eb-360c-48ae-aabe-cc01caf99a85 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10330.766649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0dc89eb-360c-48ae-aabe-cc01caf99a85" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10330.766716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0dc89eb-360c-48ae-aabe-cc01caf99a85" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10330.766967] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0dc89eb-360c-48ae-aabe-cc01caf99a85" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10330.767062] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0dc89eb-360c-48ae-aabe-cc01caf99a85',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10331.271855] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0dc89eb-360c-48ae-aabe-cc01caf99a85 [10331.272185] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10331.272414] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10331.273140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10331.273140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10331.273140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10331.273140] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0dc89eb-360c-48ae-aabe-cc01caf99a85 already deleted. [10331.273140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0dc89eb-360c-48ae-aabe-cc01caf99a85" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10335.767845] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10335.768150] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10340.768695] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10340.768987] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10345.769509] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10345.769753] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10350.770472] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10350.770869] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10355.772144] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10355.772394] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10360.773606] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10360.773945] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10362.982613] env[65939]: INFO networking_nsxv3.common.synchronization [req-04f9071f-96d0-45fb-b713-34f7198e2121 req-1448ca35-cdd5-44dc-8c96-0181488965f9 tempest-AttachVolumeTestJSON-692976414 tempest-AttachVolumeTestJSON-692976414-project-member] Enqueued Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_members [10362.983202] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGHEST for action security_group_members [10362.983561] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f93f7997-4b3f-423d-a690-47bbfb3c31ee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10362.983675] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10362.983742] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10362.984434] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10362.984615] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10362.984970] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10362.984970] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10362.984970] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10362.985128] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10362.985213] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10363.488108] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10363.488202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10363.488237] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10363.488453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10363.488550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10363.488797] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10363.488875] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10363.488968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10363.489091] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10363.489168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10363.489257] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee is going to be updated. [10363.520550] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10363.520702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10363.520702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10363.520868] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10363.521022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10363.537023] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee in Status: IN_PROGRESS for 2s [10365.546753] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee in Status: SUCCESS [10365.547023] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee deletion is rescheduled due to dependency. [10365.547069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10367.895895] env[65939]: INFO networking_nsxv3.common.synchronization [req-6fc660da-1a29-4c97-b566-1b93b135ff68 req-5116da05-4d74-483b-a08f-dcd5035956c0 tempest-ServerActionsV293TestJSON-1024262967 tempest-ServerActionsV293TestJSON-1024262967-project-member] Enqueued Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_members [10367.896417] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGHEST for action security_group_members [10367.897266] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0448a07-8b92-443f-84c4-39c4126ca3d2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10367.897266] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10367.897266] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10367.897266] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10367.900698] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10367.900698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10367.900698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10367.900698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10367.900698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10367.900698] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10368.409623] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10368.409623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10368.409623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10368.409623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10368.409623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10368.409623] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10368.409623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10368.409623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10368.409623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10368.409623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10368.409623] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 is going to be updated. [10368.437335] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10368.437480] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10368.437611] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10368.437753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10368.437902] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10368.447271] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 in Status: IN_PROGRESS for 2s [10369.204310] env[65939]: INFO networking_nsxv3.common.synchronization [None req-696f9b39-cc71-4d87-a1d6-bba3a82b50be tempest-AttachVolumeTestJSON-692976414 tempest-AttachVolumeTestJSON-692976414-project-member] Enqueued Resource ID: 33e57c5c-727a-4c5e-bfc6-78b863c770da with Priority: HIGHEST for action security_group_rules [10369.204826] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e57c5c-727a-4c5e-bfc6-78b863c770da with Priority: HIGHEST for action security_group_rules [10369.205174] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e57c5c-727a-4c5e-bfc6-78b863c770da taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10369.206024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e57c5c-727a-4c5e-bfc6-78b863c770da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10369.206024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e57c5c-727a-4c5e-bfc6-78b863c770da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10369.206024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e57c5c-727a-4c5e-bfc6-78b863c770da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10369.206024] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e57c5c-727a-4c5e-bfc6-78b863c770da',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10369.297152] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b033864a-757e-4147-9765-444d6f0fe388 tempest-AttachVolumeTestJSON-692976414 tempest-AttachVolumeTestJSON-692976414-project-member] Enqueued Resource ID: 33e57c5c-727a-4c5e-bfc6-78b863c770da with Priority: HIGHEST for action security_group_rules [10369.297793] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e57c5c-727a-4c5e-bfc6-78b863c770da with Priority: HIGHEST for action security_group_rules [10369.298151] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33e57c5c-727a-4c5e-bfc6-78b863c770da taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10369.298258] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33e57c5c-727a-4c5e-bfc6-78b863c770da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10369.730693] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10369.730895] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10369.730940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10369.731228] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10369.731332] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10369.731430] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e57c5c-727a-4c5e-bfc6-78b863c770da already deleted. [10369.731588] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e57c5c-727a-4c5e-bfc6-78b863c770da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10369.731774] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33e57c5c-727a-4c5e-bfc6-78b863c770da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10369.731965] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33e57c5c-727a-4c5e-bfc6-78b863c770da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10369.732545] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33e57c5c-727a-4c5e-bfc6-78b863c770da',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10370.252091] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10370.252459] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10370.252459] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10370.252577] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10370.252626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10370.252699] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33e57c5c-727a-4c5e-bfc6-78b863c770da already deleted. [10370.252778] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33e57c5c-727a-4c5e-bfc6-78b863c770da" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10370.456554] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 in Status: SUCCESS [10370.456554] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 deletion is rescheduled due to dependency. [10370.456554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10374.298459] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10374.298849] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10379.299590] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10379.299835] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10384.300787] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10384.301056] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10389.302194] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10389.302574] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10394.302875] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10394.303143] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10399.085263] env[65939]: INFO networking_nsxv3.common.synchronization [None req-2973446c-ad75-4ef1-8e56-102dc0618ccb None None] Enqueued Resource ID: 12e609e1-53f5-4ff9-8b4b-e6c950ddfba9 with Priority: HIGHEST for action port [10399.085752] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e609e1-53f5-4ff9-8b4b-e6c950ddfba9 with Priority: HIGHEST for action port [10399.086092] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e609e1-53f5-4ff9-8b4b-e6c950ddfba9 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10399.086183] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e609e1-53f5-4ff9-8b4b-e6c950ddfba9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10399.087036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e609e1-53f5-4ff9-8b4b-e6c950ddfba9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10399.087036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e609e1-53f5-4ff9-8b4b-e6c950ddfba9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10399.087036] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e609e1-53f5-4ff9-8b4b-e6c950ddfba9',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10399.589625] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12e609e1-53f5-4ff9-8b4b-e6c950ddfba9 [10399.589888] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10399.591442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10399.591442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10399.591442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10399.591442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10399.591442] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12e609e1-53f5-4ff9-8b4b-e6c950ddfba9 already deleted. [10399.591442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e609e1-53f5-4ff9-8b4b-e6c950ddfba9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10401.303454] env[65939]: INFO networking_nsxv3.common.synchronization [None req-a05cb3c1-4297-4613-85e4-8ecdc44ad8bd None None] Enqueued Resource ID: a8afcead-9067-4bc7-948f-e7cc25472b97 with Priority: HIGHEST for action port [10401.304229] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8afcead-9067-4bc7-948f-e7cc25472b97 with Priority: HIGHEST for action port [10401.305868] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8afcead-9067-4bc7-948f-e7cc25472b97 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10401.305868] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8afcead-9067-4bc7-948f-e7cc25472b97" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10401.305868] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8afcead-9067-4bc7-948f-e7cc25472b97" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10401.305868] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8afcead-9067-4bc7-948f-e7cc25472b97" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10401.305868] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8afcead-9067-4bc7-948f-e7cc25472b97',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10401.806887] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8afcead-9067-4bc7-948f-e7cc25472b97 [10401.807163] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10401.807299] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10401.807369] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10401.807600] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10401.807689] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10401.807788] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8afcead-9067-4bc7-948f-e7cc25472b97 already deleted. [10401.807901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8afcead-9067-4bc7-948f-e7cc25472b97" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10406.134334] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:40 completed [10406.135128] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:41 started [10406.304679] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10406.304797] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10408.552785] env[65939]: INFO networking_nsxv3.common.synchronization [None req-24a030a0-1e6c-4044-8212-8570e85ef2c2 None None] Enqueued Resource ID: 88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2 with Priority: HIGHEST for action port [10408.553437] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2 with Priority: HIGHEST for action port [10408.553780] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10408.553932] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10408.554117] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10408.554490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10408.554555] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10409.057115] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2 [10409.058484] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10409.058484] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10409.058484] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10409.058484] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10409.058484] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10409.058484] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2 already deleted. [10409.058484] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88f49f55-f0ef-4b47-ab85-3b48ca0fdbf2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10410.609375] env[65939]: INFO networking_nsxv3.common.synchronization [None req-60ded7e0-95d3-4c42-b894-dfd302ea3629 None None] Enqueued Resource ID: 41b5becd-044b-4f4e-9616-f9a88c2a1667 with Priority: HIGHEST for action port [10410.609375] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41b5becd-044b-4f4e-9616-f9a88c2a1667 with Priority: HIGHEST for action port [10410.609751] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-41b5becd-044b-4f4e-9616-f9a88c2a1667 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10410.610557] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41b5becd-044b-4f4e-9616-f9a88c2a1667" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10410.610734] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41b5becd-044b-4f4e-9616-f9a88c2a1667" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10410.611090] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41b5becd-044b-4f4e-9616-f9a88c2a1667" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10410.611274] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41b5becd-044b-4f4e-9616-f9a88c2a1667',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10411.114937] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41b5becd-044b-4f4e-9616-f9a88c2a1667 [10411.115821] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10411.115821] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10411.115821] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10411.115821] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10411.115821] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10411.115821] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41b5becd-044b-4f4e-9616-f9a88c2a1667 already deleted. [10411.116098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41b5becd-044b-4f4e-9616-f9a88c2a1667" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10412.060190] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10412.060591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10412.060591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10412.060591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10412.060727] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10412.562615] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10413.065202] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10413.569021] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [10413.569442] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [10414.353049] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.353049] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.353387] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.353387] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.368540] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [10414.369759] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.371644] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [10414.399322] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.400823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.400823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.400823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.406909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.407419] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [10414.407567] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10414.407698] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [10414.439170] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.439329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.439401] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.439609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.440404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.440583] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [10414.481929] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.482180] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.482308] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.482584] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.482835] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.483076] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [10414.526834] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.526985] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.527066] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.527269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.527443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.527620] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:18. [10414.528301] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f47963db-7b78-435b-9e39-5f259f042bf4', '152e138c-a16f-4ab1-ae1d-27177515f5d0', '0bc9971a-4944-4376-bed1-dab9f3b05345', '0d8ad0b7-d8c7-421f-909b-f64756a0f7e0', 'f93f7997-4b3f-423d-a690-47bbfb3c31ee', 'ed701299-54b2-4fb1-b7d6-f2f2b3925210', 'c0448a07-8b92-443f-84c4-39c4126ca3d2', '71daec27-b0f6-4e1c-818d-ad3a56644326', '7bb3e04f-6e66-47c4-8e1c-e6c56d139b32', 'f040ac16-496e-4b1e-b10a-6e1bc87cecaa', '4415b353-eee7-421d-a222-35308d9d05b7', '333e0845-02d8-4c70-8281-e3130037fa8e', '62f0f078-b1aa-4721-8b07-eb126a6fb449', '4361c451-dad4-41c4-b71f-bbfd50f8ea0d', '2ac3248a-183f-4532-817e-246814962f51', '95cc14d0-8b63-4ace-a5e1-f800e80faf90', '5e5444fe-a221-4357-9950-de3a392af0b6', '53e4c22f-a8a1-4d6a-8ecc-2a114db2d685'} {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10414.528301] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [10414.547876] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.548010] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.548010] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.548272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.548379] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.548497] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [10414.548567] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10414.548668] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [10414.665649] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.665848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.665913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.666229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.666665] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.666845] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [10414.666922] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10414.666994] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [10414.667068] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [10414.667143] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 18/18 resources of Type:Security Group Rules [10414.667224] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGH for action security_group_rules [10414.667288] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGH for action security_group_rules [10414.667475] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGH for action security_group_rules [10414.667475] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGH for action security_group_rules [10414.667475] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGH for action security_group_rules [10414.667686] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGH for action security_group_rules [10414.667686] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGH for action security_group_rules [10414.667686] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGH for action security_group_rules [10414.667766] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGH for action security_group_rules [10414.667766] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGH for action security_group_rules [10414.667825] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGH for action security_group_rules [10414.668492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGH for action security_group_rules [10414.668492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGH for action security_group_rules [10414.668492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGH for action security_group_rules [10414.668492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGH for action security_group_rules [10414.668492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGH for action security_group_rules [10414.668492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGH for action security_group_rules [10414.668492] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_rules [10414.668492] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [10414.668492] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [10414.668918] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.668918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.668918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.668918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.668918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.669106] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.669209] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.669240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.671496] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.671496] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.671496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.671964] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.671964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.671964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.671964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.671964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.671964] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.671964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.671964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.671964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.671964] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.672345] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.672345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.672345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.672345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.672345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.672345] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.672562] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.672562] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.672626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.672658] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.672889] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.672889] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.673013] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.673080] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.673144] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.673457] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.673648] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.673648] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.673757] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.673831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.673991] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.674090] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.674150] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.674280] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.674349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.674514] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.674601] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.674652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.674783] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.674853] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.675021] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.675110] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.675168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.675295] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.675364] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.675527] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.675615] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.675667] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.675796] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.675863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.676033] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.676122] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.676178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.676304] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.676374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.676535] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.676621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.676677] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.676802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.676871] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.677065] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.677159] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.677215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.677346] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.677416] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.677577] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.677663] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.677719] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.677845] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.677913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.678096] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.678185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.678240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.678369] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.678440] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.678599] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.678686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.678805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.678864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.678934] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.679106] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.679193] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.679243] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.679373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.679443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.679634] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.679724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.679785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.679915] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.679985] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.680189] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.680247] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.680310] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.680449] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.680523] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.680687] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.680775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.680828] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.680958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.681040] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.681200] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.681287] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.681360] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.681496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.681567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.681729] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.681817] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.681869] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.681997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.682079] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.682238] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.682325] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.682382] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.682505] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.682574] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.682735] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.682844] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.682878] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.682993] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.683074] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.683339] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10414.683339] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10414.683428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10414.684998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10414.685126] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10414.685281] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:12 [10414.685487] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 2 of least updated resources [10414.685487] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 457c3391-d047-439c-9df9-3b1b715ca405 with Priority: HIGH for action port [10414.685586] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 with Priority: HIGH for action port [10414.685670] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10415.610482] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10415.610744] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [10415.610744] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGH for action security_group_rules [10415.610878] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGH for action security_group_rules [10415.610926] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGH for action security_group_rules [10415.611047] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGH for action security_group_rules [10415.611176] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 with Priority: HIGH for action port [10415.611289] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457c3391-d047-439c-9df9-3b1b715ca405 with Priority: HIGH for action port [10415.611401] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_rules [10415.611524] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGH for action security_group_rules [10415.611622] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGH for action security_group_rules [10415.611714] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGH for action security_group_rules [10415.611805] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGH for action security_group_rules [10415.611892] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGH for action security_group_rules [10415.611979] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGH for action security_group_rules [10415.612078] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGH for action security_group_rules [10415.612164] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGH for action security_group_rules [10415.612249] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGH for action security_group_rules [10415.612336] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGH for action security_group_rules [10415.612423] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGH for action security_group_rules [10415.612512] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGH for action security_group_rules [10415.612598] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGH for action security_group_rules [10415.612947] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f47963db-7b78-435b-9e39-5f259f042bf4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.613089] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.613153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.613356] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.613437] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.616251] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.616339] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.616409] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.616593] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.616667] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.617740] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0448a07-8b92-443f-84c4-39c4126ca3d2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.617867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.617940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.618136] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.619341] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.619341] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.620765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.620765] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.620872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.621537] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.622087] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.622208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.622352] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.622475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.623328] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.624820] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-457c3391-d047-439c-9df9-3b1b715ca405 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.624820] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.624820] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.624820] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.625068] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457c3391-d047-439c-9df9-3b1b715ca405',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.631240] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.631240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.631240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.631240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.631240] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.633426] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5444fe-a221-4357-9950-de3a392af0b6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.636016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.636016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.636016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.636016] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.636016] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.636016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.636016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.636016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.636016] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.636016] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.636802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.636980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.637636] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.637875] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.638985] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.639293] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.639466] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.639725] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.640021] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.640932] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.641262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.641669] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.642065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.642679] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.643644] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.643915] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.645655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.645655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.645655] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.645655] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.645655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.645655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.645655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.645655] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.646557] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.646901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.647110] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.647366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.647584] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.648918] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.649185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.649353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.649585] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.649743] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.651802] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71daec27-b0f6-4e1c-818d-ad3a56644326 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.652199] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.652413] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.652754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.653041] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.655749] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.655749] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.655749] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.655749] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.655749] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.655749] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-152e138c-a16f-4ab1-ae1d-27177515f5d0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.656148] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.656339] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.656615] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.656782] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.657880] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.658166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.658411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.658693] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.658878] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10415.690680] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.691168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.691168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.691168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.700962] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.701087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.711072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10415.711308] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f47963db-7b78-435b-9e39-5f259f042bf4 is going to be deleted. [10415.717358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.717808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.737912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10415.738041] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac3248a-183f-4532-817e-246814962f51 is going to be deleted. [10415.784155] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.784155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.784155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.784155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.784155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10415.784155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10415.789465] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10415.789465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10415.789607] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10415.789911] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10415.789911] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10415.790046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.167210] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 457c3391-d047-439c-9df9-3b1b715ca405 with status ACTIVE [10416.167508] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.167723] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.167819] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.168093] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.168225] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.168579] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.168579] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.168749] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.168914] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.169009] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.169202] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.169328] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.169358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.169480] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.169554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.169635] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 457c3391-d047-439c-9df9-3b1b715ca405 is going to be updated. [10416.172295] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.172474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.172589] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.172820] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.172954] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.173100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.173203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.173380] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.173640] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.173918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.174125] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.175710] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.175903] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.176017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.176258] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.176466] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.177428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.177428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.177428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.177428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.177428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.177428] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.178401] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 with status ACTIVE [10416.178401] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.178527] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.178598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.178785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.178928] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.179149] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.179321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.179422] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.179649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.179900] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.180029] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.180243] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.180303] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.180497] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.180612] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.180732] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506 is going to be updated. [10416.181829] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.181987] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.182131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.182313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.182465] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.182631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.182631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.182789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.182826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.182901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.182986] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.184849] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.184958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.185412] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.185632] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.185822] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.185962] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.186283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.186283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.186283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.186467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.186565] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.188714] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.188878] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.188981] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.189192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.189445] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.189638] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.189785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.189987] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.190123] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.190232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.190342] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.197119] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.239302] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.239508] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.239602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.239848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.251312] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.251420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.252810] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.252920] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.254098] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.254265] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.255189] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.255358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.258108] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.258229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.259081] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.259183] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.259967] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.260087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.260789] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.260882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.264287] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.264416] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be deleted. [10416.265371] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.265596] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.267151] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.267274] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.267342] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.267560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.267686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.267829] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-457c3391-d047-439c-9df9-3b1b715ca405" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.268891] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.269018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.269089] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.269241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.269353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.269494] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3c71bbe-7c75-4e6b-9e90-eb0ba91ba506" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.270289] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.270441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.271442] env[65939]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [10416.271802] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.271892] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.288224] env[65939]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [10416.288808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.288937] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 is going to be deleted. [10416.289824] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.290222] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.325527] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.325689] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be deleted. [10416.326639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.326860] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.330149] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.330149] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.360461] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.360617] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee is going to be deleted. [10416.361828] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.361828] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.393899] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.394030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.413102] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.413335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.444338] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.444338] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 is going to be deleted. [10416.445168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.445398] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.471146] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.471231] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be deleted. [10416.473041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.473041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.517052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.517204] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 is going to be deleted. [10416.518250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.518489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.558109] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.558251] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5444fe-a221-4357-9950-de3a392af0b6 is going to be deleted. [10416.559233] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.560030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.572365] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.572493] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.615182] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.615182] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.658806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.659405] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 is going to be deleted. [10416.660033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.660283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.668117] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.668236] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.693939] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.694176] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.694273] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.694521] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.694705] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.694810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.694874] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.695052] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.695145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.695230] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.695380] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.695493] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.695578] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.695757] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.695899] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.695989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.696061] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.696203] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.696280] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.696372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.696503] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.697677] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.697795] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.697859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.698036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.698182] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.698311] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.698415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.698555] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.698639] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.698726] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.698877] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.699022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.699103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.699255] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.699636] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.699636] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.699636] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.699823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.699823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.699823] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.699915] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.700853] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.702715] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.702817] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.703106] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.703215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.703283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.703475] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.703624] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.703721] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.703872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.703947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.704080] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.704202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.704474] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.704474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.704631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.704664] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.704795] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.704885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.704944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.705095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.705170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.705247] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.705340] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10416.710974] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.711126] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 is going to be deleted. [10416.712751] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 333e0845-02d8-4c70-8281-e3130037fa8e: rpc.has_security_group_logging(os_id): False [10416.714422] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.715100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.742654] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.742947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.759445] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.759445] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.772944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.772944] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 is going to be deleted. [10416.772944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.773081] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.773321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.773321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.774132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.774348] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.774445] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.774578] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.775205] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.775399] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.775629] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.775695] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.775844] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.776026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.776102] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.776220] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.776353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.776498] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.776575] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.776687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.776813] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.776994] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.777961] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.778166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.778380] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.778581] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.778677] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.778862] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.780113] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.780301] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.780428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.780556] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.780735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.780913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.802888] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.803080] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.820018] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.822598] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.822598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.822598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.822598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.822598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.822598] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e is going to be updated. [10416.822598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.822598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.822598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.822980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.925036] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.925036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.925036] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.925216] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.925216] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.925286] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.927957] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.928120] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.928191] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.928417] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.928506] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.928681] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10416.982781] env[65939]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [10416.983558] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10416.983558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10416.983723] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10416.983859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10416.983999] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.008616] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: IN_PROGRESS for 2s [10417.202584] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f040ac16-496e-4b1e-b10a-6e1bc87cecaa: rpc.has_security_group_logging(os_id): False [10417.203824] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95cc14d0-8b63-4ace-a5e1-f800e80faf90: rpc.has_security_group_logging(os_id): False [10417.207607] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685: rpc.has_security_group_logging(os_id): False [10417.208303] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4361c451-dad4-41c4-b71f-bbfd50f8ea0d: rpc.has_security_group_logging(os_id): False [10417.237835] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.238025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.238025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.238237] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.240060] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.240188] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.240918] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.241037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.241715] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.241804] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.273537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.274378] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.274378] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.274378] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.274576] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.274576] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.274702] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.274799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.274859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.275023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.275121] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.275350] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.275549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.275549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.275549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.275746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.275746] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 is going to be updated. [10417.277069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.277233] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.304054] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.304464] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.304572] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.304640] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.305055] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.305170] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.305293] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 is going to be updated. [10417.306726] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.306967] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.337223] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.337475] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.337607] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.337674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.337878] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.337959] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.338708] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.338708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.338708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.338708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.338708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.338708] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.338968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.338968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.338968] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.339064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.339153] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10417.340149] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.340307] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.356776] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.356898] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.361775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.362054] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.362188] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.362256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.362457] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.362540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.362730] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.362846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.362924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.363087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.363163] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.363354] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.363438] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.363501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.363640] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.363715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.363797] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa is going to be updated. [10417.364844] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.365046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.365159] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.380168] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: IN_PROGRESS for 2s [10417.402557] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.402687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.402730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.403504] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.403504] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.427883] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.428048] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.428111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.428323] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.428469] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.435370] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: IN_PROGRESS for 2s [10417.464392] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10417.477569] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10417.477569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10417.477569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10417.477569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10417.477569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10417.508768] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: IN_PROGRESS for 2s [10419.022462] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: SUCCESS [10419.022776] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10419.393119] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: SUCCESS [10419.393349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10419.448971] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: SUCCESS [10419.448971] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10419.474356] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10419.474585] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10419.522672] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: SUCCESS [10419.522932] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10419.598025] env[65939]: INFO networking_nsxv3.common.synchronization [req-07e868f3-f193-4e33-a8e0-771fb658e338 req-a49ef322-ec62-429f-80bc-5468f5012e0b tempest-ServersAdminTestJSON-304522112 tempest-ServersAdminTestJSON-304522112-project-member] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10419.598974] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10419.598974] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10419.599455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10419.599455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10419.599455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10419.599628] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10419.599628] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10419.599729] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10419.599948] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10419.600093] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10419.604017] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10420.105946] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10420.608931] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10421.111585] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10421.111866] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10421.111866] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10421.112494] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10421.112494] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10421.112494] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10421.155519] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10421.155687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10421.155741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10421.155936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10421.156096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10421.165442] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10423.178610] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10423.178610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10423.478323] env[65939]: INFO networking_nsxv3.common.synchronization [None req-82d6ff3e-3153-41bf-8fa2-963b244cd5da None None] Enqueued Resource ID: db550492-1a13-4302-b422-eebbe3f329cf with Priority: HIGHEST for action port [10423.478829] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db550492-1a13-4302-b422-eebbe3f329cf with Priority: HIGHEST for action port [10423.479149] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-db550492-1a13-4302-b422-eebbe3f329cf taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10423.479272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db550492-1a13-4302-b422-eebbe3f329cf" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10423.479340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db550492-1a13-4302-b422-eebbe3f329cf" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10423.479637] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db550492-1a13-4302-b422-eebbe3f329cf" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10423.479669] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db550492-1a13-4302-b422-eebbe3f329cf',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10423.981587] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db550492-1a13-4302-b422-eebbe3f329cf [10423.982026] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10423.982026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10423.982154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10423.982261] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10423.983057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10423.983057] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db550492-1a13-4302-b422-eebbe3f329cf already deleted. [10423.983057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db550492-1a13-4302-b422-eebbe3f329cf" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10424.592295] env[65939]: INFO networking_nsxv3.common.synchronization [None req-78c787b6-664f-4b88-a0cd-79f91b717781 tempest-ServersTestManualDisk-1743200449 tempest-ServersTestManualDisk-1743200449-project-member] Enqueued Resource ID: 7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a with Priority: HIGHEST for action security_group_rules [10424.592916] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a with Priority: HIGHEST for action security_group_rules [10424.594112] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10424.594232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10424.594293] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10424.594686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10424.594686] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10424.693792] env[65939]: INFO networking_nsxv3.common.synchronization [None req-4becb9d6-38e8-4471-9e6b-4f8c50af3d01 tempest-ServersTestManualDisk-1743200449 tempest-ServersTestManualDisk-1743200449-project-member] Enqueued Resource ID: 7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a with Priority: HIGHEST for action security_group_rules [10424.694104] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a with Priority: HIGHEST for action security_group_rules [10424.694518] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10424.694518] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10425.115104] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10425.115341] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10425.115341] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10425.115528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10425.115631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10425.115728] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a already deleted. [10425.115813] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10425.116163] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10425.116163] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10425.116295] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10425.477293] env[65939]: INFO networking_nsxv3.common.synchronization [None req-f1a9c20b-142a-4636-902c-84daa3aeb211 None None] Enqueued Resource ID: 62fe2383-8d6e-4059-b79f-1eb2d1e06605 with Priority: HIGHEST for action port [10425.477820] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62fe2383-8d6e-4059-b79f-1eb2d1e06605 with Priority: HIGHEST for action port [10425.478679] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-62fe2383-8d6e-4059-b79f-1eb2d1e06605 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10425.478679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62fe2383-8d6e-4059-b79f-1eb2d1e06605" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10425.478877] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62fe2383-8d6e-4059-b79f-1eb2d1e06605" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10425.479355] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62fe2383-8d6e-4059-b79f-1eb2d1e06605" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10425.479355] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62fe2383-8d6e-4059-b79f-1eb2d1e06605',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10425.638577] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10425.638940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10425.638940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10425.639168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10425.639290] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10425.639421] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a already deleted. [10425.639539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a1ab794-5f9e-4929-a2e5-0ed8abf54d4a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10425.981712] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62fe2383-8d6e-4059-b79f-1eb2d1e06605 [10425.982087] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10425.982187] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10425.982187] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10425.982407] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10425.982504] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10425.982639] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62fe2383-8d6e-4059-b79f-1eb2d1e06605 already deleted. [10425.982776] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62fe2383-8d6e-4059-b79f-1eb2d1e06605" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10426.160016] env[65939]: INFO networking_nsxv3.common.synchronization [req-bb89a134-c077-4cdd-9c18-e177f85e271d req-e29dc455-f3ca-49ed-83b7-c6a7c28ab45e tempest-ServersAdminTestJSON-304522112 tempest-ServersAdminTestJSON-304522112-project-member] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10426.160016] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10426.160016] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10426.160016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10426.160337] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10426.160524] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10426.160683] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10426.160782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10426.160841] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10426.160998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10426.164081] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10426.164081] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10426.663749] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10426.975647] env[65939]: INFO networking_nsxv3.common.synchronization [req-d8e10fb9-60f4-4419-93eb-a211306e29f5 req-5b9b6156-fbbd-47df-b8a9-a3d08fa6bc24 tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_members [10426.976463] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGHEST for action security_group_members [10426.977139] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10426.977324] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10426.977416] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10426.977633] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10426.977817] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10426.977940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10426.978040] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10426.978311] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10426.978423] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10426.978536] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10427.170604] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10427.481054] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10427.481228] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10427.481300] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10427.481607] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10427.481707] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10427.481932] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10427.482047] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10427.482113] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10427.482274] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10427.482333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10427.482418] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e is going to be updated. [10427.513727] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10427.513881] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10427.513950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10427.514174] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10427.514321] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10427.524010] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: IN_PROGRESS for 2s [10427.672307] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10427.672570] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10427.672570] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10427.672743] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10427.672851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10427.672953] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10427.705332] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10427.705547] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10427.705606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10427.705804] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10427.705947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10427.715064] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10429.536535] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 333e0845-02d8-4c70-8281-e3130037fa8e in Status: SUCCESS [10429.536535] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e deletion is rescheduled due to dependency. [10429.536535] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10429.726669] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10429.726669] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10429.990956] env[65939]: INFO networking_nsxv3.common.synchronization [None req-aa34f81b-e7d2-4733-8778-9bb89851f75b None None] Enqueued Resource ID: 94dca921-7d81-4934-84d6-58deee4389e7 with Priority: HIGHEST for action port [10429.991231] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94dca921-7d81-4934-84d6-58deee4389e7 with Priority: HIGHEST for action port [10429.991563] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-94dca921-7d81-4934-84d6-58deee4389e7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10429.991688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94dca921-7d81-4934-84d6-58deee4389e7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10429.991756] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94dca921-7d81-4934-84d6-58deee4389e7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10429.992017] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94dca921-7d81-4934-84d6-58deee4389e7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10429.992102] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94dca921-7d81-4934-84d6-58deee4389e7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10430.495567] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94dca921-7d81-4934-84d6-58deee4389e7 [10430.495567] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10430.495567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10430.495567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10430.495567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10430.495567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10430.495567] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94dca921-7d81-4934-84d6-58deee4389e7 already deleted. [10430.495567] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94dca921-7d81-4934-84d6-58deee4389e7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10432.307083] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ba64c14d-f5ab-4f13-a3a7-c65e8002439e None None] Enqueued Resource ID: 7ab73887-04de-4671-adaa-e8bae4de9d78 with Priority: HIGHEST for action port [10432.307691] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ab73887-04de-4671-adaa-e8bae4de9d78 with Priority: HIGHEST for action port [10432.308011] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ab73887-04de-4671-adaa-e8bae4de9d78 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10432.308187] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ab73887-04de-4671-adaa-e8bae4de9d78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10432.308283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ab73887-04de-4671-adaa-e8bae4de9d78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10432.308563] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ab73887-04de-4671-adaa-e8bae4de9d78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10432.308651] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ab73887-04de-4671-adaa-e8bae4de9d78',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10432.810430] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ab73887-04de-4671-adaa-e8bae4de9d78 [10432.810710] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10432.810866] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10432.810933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10432.811195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10432.811279] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10432.811383] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ab73887-04de-4671-adaa-e8bae4de9d78 already deleted. [10432.811464] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ab73887-04de-4671-adaa-e8bae4de9d78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10433.290145] env[65939]: INFO networking_nsxv3.common.synchronization [None req-2dd6dd35-62ed-43bc-9d44-f3fe711d67b2 tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: 936b11d8-cb00-4eba-af42-7e4171edadcc with Priority: HIGHEST for action security_group_rules [10433.290808] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936b11d8-cb00-4eba-af42-7e4171edadcc with Priority: HIGHEST for action security_group_rules [10433.291221] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-936b11d8-cb00-4eba-af42-7e4171edadcc taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10433.291405] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-936b11d8-cb00-4eba-af42-7e4171edadcc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10433.291486] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-936b11d8-cb00-4eba-af42-7e4171edadcc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10433.291771] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-936b11d8-cb00-4eba-af42-7e4171edadcc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10433.291858] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('936b11d8-cb00-4eba-af42-7e4171edadcc',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10433.383301] env[65939]: INFO networking_nsxv3.common.synchronization [None req-937f484f-e6ed-4917-8c7f-6dfa49d2883b tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: 936b11d8-cb00-4eba-af42-7e4171edadcc with Priority: HIGHEST for action security_group_rules [10433.383875] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936b11d8-cb00-4eba-af42-7e4171edadcc with Priority: HIGHEST for action security_group_rules [10433.384202] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-936b11d8-cb00-4eba-af42-7e4171edadcc taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10433.384353] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-936b11d8-cb00-4eba-af42-7e4171edadcc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10433.537093] env[65939]: INFO networking_nsxv3.common.synchronization [req-2895d385-e6e0-42ba-a5a0-ce9bc169f69b req-fbbbd6ef-01e8-447a-b9ed-a3c8fe1e665f tempest-ServersAdminTestJSON-304522112 tempest-ServersAdminTestJSON-304522112-project-member] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10433.537640] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGHEST for action security_group_members [10433.538657] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10433.538657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10433.538657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10433.538657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10433.538935] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10433.538935] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10433.538935] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10433.539097] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10433.539224] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10433.539290] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10433.815143] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10433.815143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10433.815143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10433.815143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10433.815143] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10433.815143] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 936b11d8-cb00-4eba-af42-7e4171edadcc already deleted. [10433.815579] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-936b11d8-cb00-4eba-af42-7e4171edadcc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10433.815836] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-936b11d8-cb00-4eba-af42-7e4171edadcc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10433.816694] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-936b11d8-cb00-4eba-af42-7e4171edadcc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10433.816694] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('936b11d8-cb00-4eba-af42-7e4171edadcc',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10434.042019] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10434.042019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10434.042019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10434.042019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10434.042019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10434.042335] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10434.042335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10434.042335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10434.042455] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10434.042510] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10434.042610] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be updated. [10434.071587] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10434.071740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10434.071810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10434.072027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10434.072178] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10434.081310] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: IN_PROGRESS for 2s [10434.344188] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10434.344338] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10434.344412] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10434.344722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10434.344839] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10434.344939] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 936b11d8-cb00-4eba-af42-7e4171edadcc already deleted. [10434.345031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-936b11d8-cb00-4eba-af42-7e4171edadcc" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10436.090923] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d in Status: SUCCESS [10436.091267] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d deletion is rescheduled due to dependency. [10436.091267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10438.538562] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10438.538840] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10443.388076] env[65939]: INFO networking_nsxv3.common.synchronization [None req-5ad0618b-a99d-4663-886d-99234a160f19 None None] Enqueued Resource ID: 567a83f8-f1f1-475d-bfd8-c747a4e2a4a7 with Priority: HIGHEST for action port [10443.388518] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 567a83f8-f1f1-475d-bfd8-c747a4e2a4a7 with Priority: HIGHEST for action port [10443.388776] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-567a83f8-f1f1-475d-bfd8-c747a4e2a4a7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10443.388893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-567a83f8-f1f1-475d-bfd8-c747a4e2a4a7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10443.388955] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-567a83f8-f1f1-475d-bfd8-c747a4e2a4a7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10443.389222] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-567a83f8-f1f1-475d-bfd8-c747a4e2a4a7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10443.389301] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('567a83f8-f1f1-475d-bfd8-c747a4e2a4a7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10443.896025] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 567a83f8-f1f1-475d-bfd8-c747a4e2a4a7 [10443.896025] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10443.896025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10443.896025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10443.896025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10443.896025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10443.896025] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:567a83f8-f1f1-475d-bfd8-c747a4e2a4a7 already deleted. [10443.896025] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-567a83f8-f1f1-475d-bfd8-c747a4e2a4a7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10445.566709] env[65939]: INFO networking_nsxv3.common.synchronization [None req-7fcb5c5c-8cbd-486f-95c3-d7bc446c3970 None None] Enqueued Resource ID: e819baab-b666-47e8-a5ca-7169cee8dda4 with Priority: HIGHEST for action port [10445.567345] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e819baab-b666-47e8-a5ca-7169cee8dda4 with Priority: HIGHEST for action port [10445.567652] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-e819baab-b666-47e8-a5ca-7169cee8dda4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10445.567768] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e819baab-b666-47e8-a5ca-7169cee8dda4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10445.567837] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e819baab-b666-47e8-a5ca-7169cee8dda4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10445.568101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e819baab-b666-47e8-a5ca-7169cee8dda4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10445.568181] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e819baab-b666-47e8-a5ca-7169cee8dda4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10446.070134] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e819baab-b666-47e8-a5ca-7169cee8dda4 [10446.070453] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10446.070596] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10446.070831] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10446.070961] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10446.071045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10446.071146] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e819baab-b666-47e8-a5ca-7169cee8dda4 already deleted. [10446.071227] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e819baab-b666-47e8-a5ca-7169cee8dda4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10449.443400] env[65939]: INFO networking_nsxv3.common.synchronization [None req-48b9191c-4fda-431b-913c-7d655015e09e None None] Enqueued Resource ID: 3c258f7b-83dc-4616-b22c-60aed824aded with Priority: HIGHEST for action port [10449.443930] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c258f7b-83dc-4616-b22c-60aed824aded with Priority: HIGHEST for action port [10449.444244] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c258f7b-83dc-4616-b22c-60aed824aded taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10449.444366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c258f7b-83dc-4616-b22c-60aed824aded" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10449.444432] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c258f7b-83dc-4616-b22c-60aed824aded" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10449.444804] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c258f7b-83dc-4616-b22c-60aed824aded" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10449.444804] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c258f7b-83dc-4616-b22c-60aed824aded',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10449.950960] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c258f7b-83dc-4616-b22c-60aed824aded [10449.950960] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10449.950960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10449.950960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10449.950960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10449.950960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10449.950960] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c258f7b-83dc-4616-b22c-60aed824aded already deleted. [10449.950960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c258f7b-83dc-4616-b22c-60aed824aded" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10451.531734] env[65939]: INFO networking_nsxv3.common.synchronization [None req-2294a475-d0c5-48be-9ed6-5561ee63f57f None None] Enqueued Resource ID: 2ff93510-4cbe-423e-8238-8a9ec51e9574 with Priority: HIGHEST for action port [10451.532299] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff93510-4cbe-423e-8238-8a9ec51e9574 with Priority: HIGHEST for action port [10451.532605] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ff93510-4cbe-423e-8238-8a9ec51e9574 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10451.532725] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ff93510-4cbe-423e-8238-8a9ec51e9574" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10451.532793] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ff93510-4cbe-423e-8238-8a9ec51e9574" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10451.533308] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ff93510-4cbe-423e-8238-8a9ec51e9574" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10451.533732] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ff93510-4cbe-423e-8238-8a9ec51e9574',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10451.982602] env[65939]: INFO networking_nsxv3.common.synchronization [None req-617c9700-cddd-41ee-a8b1-0d896c5be8cf tempest-ServerActionsTestOtherA-1770217961 tempest-ServerActionsTestOtherA-1770217961-project-member] Enqueued Resource ID: 5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8 with Priority: HIGHEST for action security_group_rules [10451.983457] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8 with Priority: HIGHEST for action security_group_rules [10451.983774] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10451.983893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10451.983957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10451.984580] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10451.984902] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10452.035345] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ff93510-4cbe-423e-8238-8a9ec51e9574 [10452.035559] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10452.035683] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10452.035746] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10452.035943] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10452.036034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10452.036125] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ff93510-4cbe-423e-8238-8a9ec51e9574 already deleted. [10452.036202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ff93510-4cbe-423e-8238-8a9ec51e9574" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10452.089268] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ac069ea4-5b9a-4041-91c4-f2eae4a53309 tempest-ServerActionsTestOtherA-1770217961 tempest-ServerActionsTestOtherA-1770217961-project-member] Enqueued Resource ID: 5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8 with Priority: HIGHEST for action security_group_rules [10452.089268] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8 with Priority: HIGHEST for action security_group_rules [10452.089268] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10452.089268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10452.506189] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10452.506345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10452.506420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10452.506631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10452.506724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10452.506822] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8 already deleted. [10452.506905] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10452.507157] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10452.507320] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10452.507406] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10453.028902] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10453.029256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10453.029256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10453.029334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10453.029414] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10453.029505] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8 already deleted. [10453.029587] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f740d4b-a1bb-47b8-8f9f-2b14ec96e4a8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10457.090516] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10457.090516] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10462.092427] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10462.092700] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10467.094292] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10467.094619] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10472.094951] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10472.095233] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10477.096167] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10477.096461] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10481.005326] env[65939]: INFO networking_nsxv3.common.synchronization [None req-c4c4cbab-734b-4ff7-8eb7-baed16f8d088 tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0 with Priority: HIGHEST for action security_group_rules [10481.005886] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0 with Priority: HIGHEST for action security_group_rules [10481.006989] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10481.006989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10481.006989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10481.006989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10481.006989] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10481.090377] env[65939]: INFO networking_nsxv3.common.synchronization [None req-50da99e4-fb9d-43b6-88a5-56c852acb71d tempest-AttachInterfacesTestJSON-531507541 tempest-AttachInterfacesTestJSON-531507541-project-member] Enqueued Resource ID: 0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0 with Priority: HIGHEST for action security_group_rules [10481.090971] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0 with Priority: HIGHEST for action security_group_rules [10481.091428] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10481.091490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10481.527798] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10481.527950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10481.528034] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10481.528325] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10481.528411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10481.528507] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0 already deleted. [10481.528586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10481.528724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10481.528893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10481.528976] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10482.047714] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10482.048094] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10482.048094] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10482.048191] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10482.048241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10482.048318] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0 already deleted. [10482.048398] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ca48940-8d5a-41d9-8ed7-a8d4ca0002f0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10486.091546] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10486.091861] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10491.092775] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10491.093149] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10496.094735] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10496.095155] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10501.095699] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10501.095966] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10506.096661] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10506.097040] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10511.097940] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10511.097940] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10516.098868] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10516.098868] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10521.099667] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10521.099969] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10526.100366] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10526.100665] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10530.011618] env[65939]: INFO networking_nsxv3.common.synchronization [None req-e21d4e7d-3548-49c3-a969-03287e498f6d None None] Enqueued Resource ID: 52754893-a917-4db9-bec5-a7a713d91879 with Priority: HIGHEST for action port [10530.012223] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52754893-a917-4db9-bec5-a7a713d91879 with Priority: HIGHEST for action port [10530.012547] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-52754893-a917-4db9-bec5-a7a713d91879 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10530.012674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52754893-a917-4db9-bec5-a7a713d91879" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10530.012741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52754893-a917-4db9-bec5-a7a713d91879" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10530.013012] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52754893-a917-4db9-bec5-a7a713d91879" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10530.014078] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52754893-a917-4db9-bec5-a7a713d91879',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10530.517022] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52754893-a917-4db9-bec5-a7a713d91879 [10530.517022] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10530.517022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10530.517022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10530.517022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10530.517022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10530.517022] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52754893-a917-4db9-bec5-a7a713d91879 already deleted. [10530.517022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52754893-a917-4db9-bec5-a7a713d91879" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10531.183022] env[65939]: INFO networking_nsxv3.common.synchronization [req-7466fb0f-3667-4ad6-a97e-755659359383 req-d0bace4a-199e-4afd-b618-a4a53eb38b0d tempest-SecurityGroupRulesNegativeTestJSON-1270122345 tempest-SecurityGroupRulesNegativeTestJSON-1270122345-project-member] Enqueued Resource ID: 9ef8a5b4-4195-4164-a854-58ef9afb8971 with Priority: HIGHEST for action security_group_rules [10531.183022] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef8a5b4-4195-4164-a854-58ef9afb8971 with Priority: HIGHEST for action security_group_rules [10531.183022] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ef8a5b4-4195-4164-a854-58ef9afb8971 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10531.183022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ef8a5b4-4195-4164-a854-58ef9afb8971" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10531.183022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ef8a5b4-4195-4164-a854-58ef9afb8971" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10531.183022] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ef8a5b4-4195-4164-a854-58ef9afb8971" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10531.183022] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ef8a5b4-4195-4164-a854-58ef9afb8971',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10531.397406] env[65939]: INFO networking_nsxv3.common.synchronization [req-91173604-6dbc-473d-8d03-2cd227da287e req-917d54ed-3066-452f-b695-3c1db513ed85 tempest-SecurityGroupRulesNegativeTestJSON-1270122345 tempest-SecurityGroupRulesNegativeTestJSON-1270122345-project-member] Enqueued Resource ID: 9ef8a5b4-4195-4164-a854-58ef9afb8971 with Priority: HIGHEST for action security_group_rules [10531.397873] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef8a5b4-4195-4164-a854-58ef9afb8971 with Priority: HIGHEST for action security_group_rules [10531.398187] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ef8a5b4-4195-4164-a854-58ef9afb8971 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10531.398295] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ef8a5b4-4195-4164-a854-58ef9afb8971" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10531.704326] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10531.704666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10531.704666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10531.704876] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10531.704928] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10531.705020] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ef8a5b4-4195-4164-a854-58ef9afb8971 already deleted. [10531.705116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ef8a5b4-4195-4164-a854-58ef9afb8971" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10531.705265] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ef8a5b4-4195-4164-a854-58ef9afb8971" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10531.705421] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ef8a5b4-4195-4164-a854-58ef9afb8971" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10531.705503] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ef8a5b4-4195-4164-a854-58ef9afb8971',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10532.222165] env[65939]: INFO networking_nsxv3.common.synchronization [None req-8832b42f-9bc1-46d5-8b55-0f1d30694484 None None] Enqueued Resource ID: c9609dd7-e295-4180-be0b-9cc2bbecbd78 with Priority: HIGHEST for action port [10532.222710] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9609dd7-e295-4180-be0b-9cc2bbecbd78 with Priority: HIGHEST for action port [10532.223054] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9609dd7-e295-4180-be0b-9cc2bbecbd78 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10532.223181] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9609dd7-e295-4180-be0b-9cc2bbecbd78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10532.223246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9609dd7-e295-4180-be0b-9cc2bbecbd78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10532.223501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9609dd7-e295-4180-be0b-9cc2bbecbd78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10532.223578] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9609dd7-e295-4180-be0b-9cc2bbecbd78',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10532.232694] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10532.232827] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10532.232827] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10532.233045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10532.233095] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10532.233175] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ef8a5b4-4195-4164-a854-58ef9afb8971 already deleted. [10532.233255] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ef8a5b4-4195-4164-a854-58ef9afb8971" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10532.726100] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9609dd7-e295-4180-be0b-9cc2bbecbd78 [10532.726100] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10532.726100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10532.726100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10532.726655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10532.726990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10532.727091] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9609dd7-e295-4180-be0b-9cc2bbecbd78 already deleted. [10532.727192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9609dd7-e295-4180-be0b-9cc2bbecbd78" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10537.223971] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10537.223971] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10542.225210] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10542.225443] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10547.226211] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10547.226605] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10552.227367] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10552.227638] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10557.228790] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10557.229172] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10562.229483] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10562.229483] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10567.230814] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10567.231121] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10572.232666] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10572.233113] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10574.757410] env[65939]: INFO networking_nsxv3.common.synchronization [req-36937cfc-7977-482d-99c6-a86587db89fe req-40e6f695-29e2-4514-91d9-b04bc9381af3 tempest-FloatingIPsAssociationTestJSON-1227248827 tempest-FloatingIPsAssociationTestJSON-1227248827-project-member] Enqueued Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGHEST for action security_group_members [10574.757720] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGHEST for action security_group_members [10574.758033] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10574.758777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10574.758777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10574.758777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10574.758777] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10574.758777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10574.758777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10574.759131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10574.759131] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10574.759131] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10575.261511] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10575.261669] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10575.261735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10575.261945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10575.262058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10575.262268] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10575.262368] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10575.262430] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10575.262575] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10575.262650] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10575.262735] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa is going to be updated. [10575.296229] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10575.296393] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10575.296467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10575.296681] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10575.296832] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10575.307102] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: IN_PROGRESS for 2s [10577.169920] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b860daaf-d823-4f49-a33b-d8c704a6b04c None None] Enqueued Resource ID: bf78cc89-b247-4f6b-a91e-81cb342d3f72 with Priority: HIGHEST for action port [10577.170388] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf78cc89-b247-4f6b-a91e-81cb342d3f72 with Priority: HIGHEST for action port [10577.170701] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf78cc89-b247-4f6b-a91e-81cb342d3f72 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10577.170824] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf78cc89-b247-4f6b-a91e-81cb342d3f72" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10577.170892] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf78cc89-b247-4f6b-a91e-81cb342d3f72" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10577.171157] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf78cc89-b247-4f6b-a91e-81cb342d3f72" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10577.171243] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf78cc89-b247-4f6b-a91e-81cb342d3f72',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10577.321016] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa in Status: SUCCESS [10577.321016] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa deletion is rescheduled due to dependency. [10577.321016] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10577.674063] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf78cc89-b247-4f6b-a91e-81cb342d3f72 [10577.674063] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10577.674063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10577.674063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10577.674336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10577.674336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10577.674406] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf78cc89-b247-4f6b-a91e-81cb342d3f72 already deleted. [10577.674514] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf78cc89-b247-4f6b-a91e-81cb342d3f72" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10579.486024] env[65939]: INFO networking_nsxv3.common.synchronization [None req-bb3d1b96-c883-42be-b5ee-dc3b0f156fca None None] Enqueued Resource ID: c0be1dd0-5929-47e7-b9f9-1347892baef9 with Priority: HIGHEST for action port [10579.486412] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0be1dd0-5929-47e7-b9f9-1347892baef9 with Priority: HIGHEST for action port [10579.486461] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0be1dd0-5929-47e7-b9f9-1347892baef9 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10579.486582] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0be1dd0-5929-47e7-b9f9-1347892baef9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10579.486647] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0be1dd0-5929-47e7-b9f9-1347892baef9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10579.486940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0be1dd0-5929-47e7-b9f9-1347892baef9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10579.486976] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0be1dd0-5929-47e7-b9f9-1347892baef9',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10579.990583] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0be1dd0-5929-47e7-b9f9-1347892baef9 [10579.990583] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10579.990583] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10579.990583] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10579.990583] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10579.990583] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10579.990583] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0be1dd0-5929-47e7-b9f9-1347892baef9 already deleted. [10579.990583] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0be1dd0-5929-47e7-b9f9-1347892baef9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10581.985496] env[65939]: INFO networking_nsxv3.common.synchronization [req-8c9b268b-0668-4a34-8cba-9d568e901dd4 req-6a559de7-0794-4a86-99e9-ab2a87e19299 tempest-MigrationsAdminTest-1348166828 tempest-MigrationsAdminTest-1348166828-project-member] Enqueued Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGHEST for action security_group_members [10581.986280] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGHEST for action security_group_members [10581.986664] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10581.986792] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10581.986859] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10581.989162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10581.989162] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10581.989162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10581.989162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10581.989162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10581.989162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10581.989162] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10582.490931] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10582.491100] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10582.491168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10582.491564] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10582.491564] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10582.492621] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10582.492621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10582.492621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10582.492621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10582.492621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10582.492621] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 is going to be updated. [10582.521578] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10582.521578] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10582.521728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10582.522067] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10582.522330] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10582.533135] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: IN_PROGRESS for 2s [10584.544664] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 in Status: SUCCESS [10584.544664] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 deletion is rescheduled due to dependency. [10584.545050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10584.917047] env[65939]: INFO networking_nsxv3.common.synchronization [None req-545d0333-a029-44a6-b3a5-8406aa10017a None None] Enqueued Resource ID: 72dcb821-5616-4946-8ecb-be954545d1b7 with Priority: HIGHEST for action port [10584.917794] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72dcb821-5616-4946-8ecb-be954545d1b7 with Priority: HIGHEST for action port [10584.918135] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-72dcb821-5616-4946-8ecb-be954545d1b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10584.918263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72dcb821-5616-4946-8ecb-be954545d1b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10584.918335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72dcb821-5616-4946-8ecb-be954545d1b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10584.918587] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72dcb821-5616-4946-8ecb-be954545d1b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10584.918738] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72dcb821-5616-4946-8ecb-be954545d1b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10585.422826] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72dcb821-5616-4946-8ecb-be954545d1b7 [10585.422826] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10585.422826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10585.422826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10585.422826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10585.422826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10585.422826] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72dcb821-5616-4946-8ecb-be954545d1b7 already deleted. [10585.422826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72dcb821-5616-4946-8ecb-be954545d1b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10587.144215] env[65939]: INFO networking_nsxv3.common.synchronization [None req-0a0f0c04-f054-400f-8cf9-9f379c796699 None None] Enqueued Resource ID: 7557e201-93bb-4f4d-be14-c02e0f4a0baf with Priority: HIGHEST for action port [10587.144896] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7557e201-93bb-4f4d-be14-c02e0f4a0baf with Priority: HIGHEST for action port [10587.147015] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-7557e201-93bb-4f4d-be14-c02e0f4a0baf taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10587.147153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7557e201-93bb-4f4d-be14-c02e0f4a0baf" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10587.148589] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7557e201-93bb-4f4d-be14-c02e0f4a0baf" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10587.148589] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7557e201-93bb-4f4d-be14-c02e0f4a0baf" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10587.148589] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7557e201-93bb-4f4d-be14-c02e0f4a0baf',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10587.652893] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7557e201-93bb-4f4d-be14-c02e0f4a0baf [10587.653147] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10587.653367] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10587.653428] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10587.653634] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10587.653730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10587.653828] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7557e201-93bb-4f4d-be14-c02e0f4a0baf already deleted. [10587.653911] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7557e201-93bb-4f4d-be14-c02e0f4a0baf" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10589.016733] env[65939]: INFO networking_nsxv3.common.synchronization [None req-8035c4c7-b0ac-4891-a438-f712e8d1fe1c None None] Enqueued Resource ID: 064d40d8-a701-4906-bdd2-babea5073b40 with Priority: HIGHEST for action port [10589.016733] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 064d40d8-a701-4906-bdd2-babea5073b40 with Priority: HIGHEST for action port [10589.016733] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-064d40d8-a701-4906-bdd2-babea5073b40 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10589.016733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-064d40d8-a701-4906-bdd2-babea5073b40" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10589.016733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-064d40d8-a701-4906-bdd2-babea5073b40" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10589.016733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-064d40d8-a701-4906-bdd2-babea5073b40" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10589.016733] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('064d40d8-a701-4906-bdd2-babea5073b40',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10589.518312] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 064d40d8-a701-4906-bdd2-babea5073b40 [10589.518553] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10589.518772] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10589.518772] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10589.518971] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10589.519288] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10589.519288] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:064d40d8-a701-4906-bdd2-babea5073b40 already deleted. [10589.519288] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-064d40d8-a701-4906-bdd2-babea5073b40" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10590.202735] env[65939]: INFO networking_nsxv3.common.synchronization [None req-5026764a-f65e-49b9-b0d0-c34b4bf8e29e None None] Enqueued Resource ID: ff36179b-fc63-4d3d-8892-587585d6557a with Priority: HIGHEST for action port [10590.202986] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff36179b-fc63-4d3d-8892-587585d6557a with Priority: HIGHEST for action port [10590.203284] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff36179b-fc63-4d3d-8892-587585d6557a taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10590.203422] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff36179b-fc63-4d3d-8892-587585d6557a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10590.203490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff36179b-fc63-4d3d-8892-587585d6557a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10590.203776] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff36179b-fc63-4d3d-8892-587585d6557a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10590.203828] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff36179b-fc63-4d3d-8892-587585d6557a',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10590.707075] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff36179b-fc63-4d3d-8892-587585d6557a [10590.707377] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10590.707477] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10590.707509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10590.707798] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10590.707856] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10590.708051] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff36179b-fc63-4d3d-8892-587585d6557a already deleted. [10590.708051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff36179b-fc63-4d3d-8892-587585d6557a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10591.321452] env[65939]: INFO networking_nsxv3.common.synchronization [None req-3eeb7409-ab1d-400a-b8ab-6e8d6a3793ec None None] Enqueued Resource ID: f0a74045-9697-4ef1-bdfc-3b962c4d5d9f with Priority: HIGHEST for action port [10591.322291] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0a74045-9697-4ef1-bdfc-3b962c4d5d9f with Priority: HIGHEST for action port [10591.322291] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0a74045-9697-4ef1-bdfc-3b962c4d5d9f taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10591.322913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0a74045-9697-4ef1-bdfc-3b962c4d5d9f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10591.322913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0a74045-9697-4ef1-bdfc-3b962c4d5d9f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10591.324115] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0a74045-9697-4ef1-bdfc-3b962c4d5d9f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10591.324115] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a74045-9697-4ef1-bdfc-3b962c4d5d9f',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10591.803430] env[65939]: INFO networking_nsxv3.common.synchronization [None req-11a6b5ad-223f-44bb-92d1-a8ddb989df9d None None] Enqueued Resource ID: 476cff28-a43e-4089-9fd1-37d9fc0cb9df with Priority: HIGHEST for action port [10591.804065] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 476cff28-a43e-4089-9fd1-37d9fc0cb9df with Priority: HIGHEST for action port [10591.804400] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-476cff28-a43e-4089-9fd1-37d9fc0cb9df taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10591.804580] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-476cff28-a43e-4089-9fd1-37d9fc0cb9df" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10591.804580] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-476cff28-a43e-4089-9fd1-37d9fc0cb9df" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10591.804885] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-476cff28-a43e-4089-9fd1-37d9fc0cb9df" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10591.804972] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('476cff28-a43e-4089-9fd1-37d9fc0cb9df',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10591.827782] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0a74045-9697-4ef1-bdfc-3b962c4d5d9f [10591.827782] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10591.827782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10591.827782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10591.827782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10591.827782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10591.827782] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0a74045-9697-4ef1-bdfc-3b962c4d5d9f already deleted. [10591.827782] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0a74045-9697-4ef1-bdfc-3b962c4d5d9f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10591.972497] env[65939]: INFO networking_nsxv3.common.synchronization [None req-bed5f7b5-a7df-4aa5-bff5-54e7b1df2955 None None] Enqueued Resource ID: 58fbb629-0c31-45e2-80d6-9c7a60339de6 with Priority: HIGHEST for action port [10591.973023] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58fbb629-0c31-45e2-80d6-9c7a60339de6 with Priority: HIGHEST for action port [10591.973486] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-58fbb629-0c31-45e2-80d6-9c7a60339de6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10591.973486] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58fbb629-0c31-45e2-80d6-9c7a60339de6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10591.973651] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58fbb629-0c31-45e2-80d6-9c7a60339de6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10591.973899] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58fbb629-0c31-45e2-80d6-9c7a60339de6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10591.973899] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58fbb629-0c31-45e2-80d6-9c7a60339de6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10592.309413] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 476cff28-a43e-4089-9fd1-37d9fc0cb9df [10592.309506] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10592.309569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10592.309706] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10592.309838] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10592.310649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10592.310649] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:476cff28-a43e-4089-9fd1-37d9fc0cb9df already deleted. [10592.310649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-476cff28-a43e-4089-9fd1-37d9fc0cb9df" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10592.475838] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58fbb629-0c31-45e2-80d6-9c7a60339de6 [10592.476092] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10592.476198] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10592.476263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10592.476471] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10592.476558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10592.476654] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58fbb629-0c31-45e2-80d6-9c7a60339de6 already deleted. [10592.476755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58fbb629-0c31-45e2-80d6-9c7a60339de6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10593.195064] env[65939]: INFO networking_nsxv3.common.synchronization [None req-38e8cf12-bb68-439c-bb31-e55fb34d1934 None None] Enqueued Resource ID: f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97 with Priority: HIGHEST for action port [10593.195064] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97 with Priority: HIGHEST for action port [10593.195064] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10593.195064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10593.195064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10593.195064] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10593.195064] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10593.698433] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97 [10593.700863] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10593.700863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10593.700863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10593.700863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10593.700863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10593.700863] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97 already deleted. [10593.700863] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1fb753a-4b9d-49ee-8de5-e3ec9c6f4f97" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10594.424762] env[65939]: INFO networking_nsxv3.common.synchronization [None req-6f494b54-efec-4fc1-8c65-a13859a22420 None None] Enqueued Resource ID: a78af633-ea4e-41a1-90b2-591bdea3dc7e with Priority: HIGHEST for action port [10594.425373] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a78af633-ea4e-41a1-90b2-591bdea3dc7e with Priority: HIGHEST for action port [10594.425687] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-a78af633-ea4e-41a1-90b2-591bdea3dc7e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10594.425812] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a78af633-ea4e-41a1-90b2-591bdea3dc7e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10594.425913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a78af633-ea4e-41a1-90b2-591bdea3dc7e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10594.426621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a78af633-ea4e-41a1-90b2-591bdea3dc7e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10594.427279] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a78af633-ea4e-41a1-90b2-591bdea3dc7e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10594.932856] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a78af633-ea4e-41a1-90b2-591bdea3dc7e [10594.932856] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10594.932856] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10594.932856] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10594.933336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10594.933336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10594.933336] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a78af633-ea4e-41a1-90b2-591bdea3dc7e already deleted. [10594.933436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a78af633-ea4e-41a1-90b2-591bdea3dc7e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10595.328882] env[65939]: INFO networking_nsxv3.common.synchronization [None req-f29c02ec-f9eb-49ce-9419-f64802cd23a1 None None] Enqueued Resource ID: ba5c89c9-f130-4032-8b0a-334d818cade8 with Priority: HIGHEST for action port [10595.328882] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5c89c9-f130-4032-8b0a-334d818cade8 with Priority: HIGHEST for action port [10595.328882] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba5c89c9-f130-4032-8b0a-334d818cade8 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10595.328882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba5c89c9-f130-4032-8b0a-334d818cade8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10595.328882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba5c89c9-f130-4032-8b0a-334d818cade8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10595.328882] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba5c89c9-f130-4032-8b0a-334d818cade8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10595.328882] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba5c89c9-f130-4032-8b0a-334d818cade8',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10595.835329] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba5c89c9-f130-4032-8b0a-334d818cade8 [10595.835329] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10595.835329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10595.835329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10595.835329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10595.835329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10595.835329] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba5c89c9-f130-4032-8b0a-334d818cade8 already deleted. [10595.835329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba5c89c9-f130-4032-8b0a-334d818cade8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10596.159494] env[65939]: INFO networking_nsxv3.common.synchronization [None req-1000a1b1-e286-455d-8f65-a209c6090d32 None None] Enqueued Resource ID: ea1d5340-903e-48b2-9684-957eac343b66 with Priority: HIGHEST for action port [10596.159954] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea1d5340-903e-48b2-9684-957eac343b66 with Priority: HIGHEST for action port [10596.160284] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea1d5340-903e-48b2-9684-957eac343b66 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10596.160425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea1d5340-903e-48b2-9684-957eac343b66" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10596.160470] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea1d5340-903e-48b2-9684-957eac343b66" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10596.160763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea1d5340-903e-48b2-9684-957eac343b66" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10596.160850] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea1d5340-903e-48b2-9684-957eac343b66',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10596.663492] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea1d5340-903e-48b2-9684-957eac343b66 [10596.664194] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10596.664194] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10596.664194] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10596.664194] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10596.664373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10596.664373] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea1d5340-903e-48b2-9684-957eac343b66 already deleted. [10596.664470] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea1d5340-903e-48b2-9684-957eac343b66" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10597.277705] env[65939]: INFO networking_nsxv3.common.synchronization [None req-7d1cf289-0296-416b-9008-b51b1143702f None None] Enqueued Resource ID: 5004a4f6-5e84-42b1-adf8-96c7124d0781 with Priority: HIGHEST for action port [10597.278203] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5004a4f6-5e84-42b1-adf8-96c7124d0781 with Priority: HIGHEST for action port [10597.278591] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-5004a4f6-5e84-42b1-adf8-96c7124d0781 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10597.278718] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5004a4f6-5e84-42b1-adf8-96c7124d0781" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10597.278785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5004a4f6-5e84-42b1-adf8-96c7124d0781" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10597.279041] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5004a4f6-5e84-42b1-adf8-96c7124d0781" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10597.279126] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5004a4f6-5e84-42b1-adf8-96c7124d0781',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10597.781664] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5004a4f6-5e84-42b1-adf8-96c7124d0781 [10597.781664] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10597.781664] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10597.781664] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10597.781869] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10597.781953] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10597.782059] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5004a4f6-5e84-42b1-adf8-96c7124d0781 already deleted. [10597.782140] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5004a4f6-5e84-42b1-adf8-96c7124d0781" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10598.552586] env[65939]: INFO networking_nsxv3.common.synchronization [None req-816ffc2a-6142-4230-ace0-aa7af999d2ad None None] Enqueued Resource ID: a22e2e8e-9edc-4ced-b0b8-537bfafcfedb with Priority: HIGHEST for action port [10598.553145] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22e2e8e-9edc-4ced-b0b8-537bfafcfedb with Priority: HIGHEST for action port [10598.553572] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-a22e2e8e-9edc-4ced-b0b8-537bfafcfedb taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10598.553572] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a22e2e8e-9edc-4ced-b0b8-537bfafcfedb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10598.553937] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a22e2e8e-9edc-4ced-b0b8-537bfafcfedb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10598.553937] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a22e2e8e-9edc-4ced-b0b8-537bfafcfedb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10598.553937] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a22e2e8e-9edc-4ced-b0b8-537bfafcfedb',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10599.057912] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a22e2e8e-9edc-4ced-b0b8-537bfafcfedb [10599.058181] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10599.058315] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10599.058393] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10599.058616] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10599.058678] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10599.058795] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a22e2e8e-9edc-4ced-b0b8-537bfafcfedb already deleted. [10599.058846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a22e2e8e-9edc-4ced-b0b8-537bfafcfedb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10600.608674] env[65939]: INFO networking_nsxv3.common.synchronization [None req-8fe91801-0c2a-40fa-8c91-40da81d901d5 None None] Enqueued Resource ID: b148f95c-9e86-4d0c-807b-5793d474568b with Priority: HIGHEST for action port [10600.609342] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b148f95c-9e86-4d0c-807b-5793d474568b with Priority: HIGHEST for action port [10600.609979] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-b148f95c-9e86-4d0c-807b-5793d474568b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10600.610125] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b148f95c-9e86-4d0c-807b-5793d474568b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10600.610204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b148f95c-9e86-4d0c-807b-5793d474568b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10600.610469] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b148f95c-9e86-4d0c-807b-5793d474568b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10600.610557] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b148f95c-9e86-4d0c-807b-5793d474568b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10601.113927] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b148f95c-9e86-4d0c-807b-5793d474568b [10601.113927] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10601.113927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10601.113927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10601.113927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10601.113927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10601.114271] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b148f95c-9e86-4d0c-807b-5793d474568b already deleted. [10601.114271] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b148f95c-9e86-4d0c-807b-5793d474568b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10605.611027] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10605.611027] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10609.497271] env[65939]: INFO networking_nsxv3.common.synchronization [None req-d983f7e3-c52e-42a8-b15b-697171985007 None None] Enqueued Resource ID: 1efd08e2-2bf7-4346-95ca-7b28a0254ce5 with Priority: HIGHEST for action port [10609.497846] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1efd08e2-2bf7-4346-95ca-7b28a0254ce5 with Priority: HIGHEST for action port [10609.498483] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-1efd08e2-2bf7-4346-95ca-7b28a0254ce5 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10609.498618] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1efd08e2-2bf7-4346-95ca-7b28a0254ce5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10609.498700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1efd08e2-2bf7-4346-95ca-7b28a0254ce5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10609.498960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1efd08e2-2bf7-4346-95ca-7b28a0254ce5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10609.499063] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1efd08e2-2bf7-4346-95ca-7b28a0254ce5',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10610.001272] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1efd08e2-2bf7-4346-95ca-7b28a0254ce5 [10610.001788] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10610.002075] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10610.002235] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10610.002595] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10610.002811] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10610.003028] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1efd08e2-2bf7-4346-95ca-7b28a0254ce5 already deleted. [10610.003164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1efd08e2-2bf7-4346-95ca-7b28a0254ce5" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10611.671471] env[65939]: INFO networking_nsxv3.common.synchronization [None req-dd029ec0-f18b-4ae9-82b9-4721360b8885 None None] Enqueued Resource ID: 7036fc01-06e7-4231-88de-23e0f4a25c84 with Priority: HIGHEST for action port [10611.671977] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7036fc01-06e7-4231-88de-23e0f4a25c84 with Priority: HIGHEST for action port [10611.672464] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-7036fc01-06e7-4231-88de-23e0f4a25c84 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10611.672464] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7036fc01-06e7-4231-88de-23e0f4a25c84" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10611.672608] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7036fc01-06e7-4231-88de-23e0f4a25c84" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10611.672763] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7036fc01-06e7-4231-88de-23e0f4a25c84" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10611.672845] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7036fc01-06e7-4231-88de-23e0f4a25c84',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10612.176082] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7036fc01-06e7-4231-88de-23e0f4a25c84 [10612.176495] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10612.176647] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10612.176749] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10612.177009] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10612.177213] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10612.177868] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7036fc01-06e7-4231-88de-23e0f4a25c84 already deleted. [10612.177868] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7036fc01-06e7-4231-88de-23e0f4a25c84" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10616.673381] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10616.673686] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10621.675064] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10621.675301] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10625.836064] env[65939]: INFO networking_nsxv3.common.synchronization [None req-810a48ad-29ff-4a3e-ac22-fb2da4b75d2a None None] Enqueued Resource ID: 0ed98273-9615-4c86-ba61-a575a2cdd7d3 with Priority: HIGHEST for action port [10625.836484] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed98273-9615-4c86-ba61-a575a2cdd7d3 with Priority: HIGHEST for action port [10625.836814] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ed98273-9615-4c86-ba61-a575a2cdd7d3 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10625.836990] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ed98273-9615-4c86-ba61-a575a2cdd7d3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10625.837246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ed98273-9615-4c86-ba61-a575a2cdd7d3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10625.837577] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ed98273-9615-4c86-ba61-a575a2cdd7d3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10625.837713] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ed98273-9615-4c86-ba61-a575a2cdd7d3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10626.339670] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ed98273-9615-4c86-ba61-a575a2cdd7d3 [10626.339901] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10626.340048] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10626.340704] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10626.340704] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10626.340704] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10626.340704] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ed98273-9615-4c86-ba61-a575a2cdd7d3 already deleted. [10626.340704] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ed98273-9615-4c86-ba61-a575a2cdd7d3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10628.143676] env[65939]: INFO networking_nsxv3.common.synchronization [None req-fef80b89-91d1-47a1-96cc-6ceae28b1a33 None None] Enqueued Resource ID: c6e2f0b2-ea0f-497d-bb02-72b4311224c8 with Priority: HIGHEST for action port [10628.145280] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6e2f0b2-ea0f-497d-bb02-72b4311224c8 with Priority: HIGHEST for action port [10628.145280] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6e2f0b2-ea0f-497d-bb02-72b4311224c8 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10628.145280] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6e2f0b2-ea0f-497d-bb02-72b4311224c8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10628.145280] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6e2f0b2-ea0f-497d-bb02-72b4311224c8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10628.145280] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6e2f0b2-ea0f-497d-bb02-72b4311224c8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10628.145280] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6e2f0b2-ea0f-497d-bb02-72b4311224c8',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10628.650749] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6e2f0b2-ea0f-497d-bb02-72b4311224c8 [10628.650999] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10628.651153] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10628.651217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10628.651432] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10628.651524] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10628.651621] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6e2f0b2-ea0f-497d-bb02-72b4311224c8 already deleted. [10628.651699] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6e2f0b2-ea0f-497d-bb02-72b4311224c8" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10631.667778] env[65939]: INFO networking_nsxv3.common.synchronization [None req-867e2c58-49d8-41af-a95b-a32a1c5f04a1 tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: d26f5e50-1cbf-467b-a8cf-a1188e1228c4 with Priority: HIGHEST for action security_group_rules [10631.668064] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d26f5e50-1cbf-467b-a8cf-a1188e1228c4 with Priority: HIGHEST for action security_group_rules [10631.669026] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10631.669026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10631.669026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10631.669234] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10631.669234] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d26f5e50-1cbf-467b-a8cf-a1188e1228c4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10631.751229] env[65939]: INFO networking_nsxv3.common.synchronization [None req-a5248e13-9dcd-41c2-b613-73def37c0294 tempest-AttachVolumeNegativeTest-1004864056 tempest-AttachVolumeNegativeTest-1004864056-project-member] Enqueued Resource ID: d26f5e50-1cbf-467b-a8cf-a1188e1228c4 with Priority: HIGHEST for action security_group_rules [10631.751229] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d26f5e50-1cbf-467b-a8cf-a1188e1228c4 with Priority: HIGHEST for action security_group_rules [10631.751229] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10631.751229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10632.190736] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10632.191033] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10632.191111] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10632.191346] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10632.191444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10632.191548] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d26f5e50-1cbf-467b-a8cf-a1188e1228c4 already deleted. [10632.191642] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10632.191940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10632.191940] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10632.192087] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d26f5e50-1cbf-467b-a8cf-a1188e1228c4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10632.716608] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10632.716951] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10632.716951] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10632.717023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10632.717115] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10632.717210] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d26f5e50-1cbf-467b-a8cf-a1188e1228c4 already deleted. [10632.717291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d26f5e50-1cbf-467b-a8cf-a1188e1228c4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10636.751799] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10636.751799] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10641.753122] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10641.753452] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10646.135484] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:41 completed [10646.135796] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:42 started [10646.754423] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10646.754598] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10651.755790] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10651.756086] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10652.056998] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10652.057242] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10652.057335] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10652.057602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10652.057759] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10652.560401] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10653.063399] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10653.566410] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [10653.566512] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [10654.382851] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.383221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.383287] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.383531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.396964] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [10654.397684] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.398512] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [10654.424428] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.424614] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.424709] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.424917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.429377] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.429732] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [10654.429818] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10654.429872] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [10654.452861] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.453249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.453249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.453482] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.453840] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.453994] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [10654.498492] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.498674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.498674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.498861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.499045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.499225] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [10654.534788] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.534949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.535027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.535229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.535499] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.535694] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:5. [10654.535773] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'333e0845-02d8-4c70-8281-e3130037fa8e', '4361c451-dad4-41c4-b71f-bbfd50f8ea0d', 'f040ac16-496e-4b1e-b10a-6e1bc87cecaa', '53e4c22f-a8a1-4d6a-8ecc-2a114db2d685', '95cc14d0-8b63-4ace-a5e1-f800e80faf90'} {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10654.535848] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [10654.553611] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.553611] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.553611] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.553840] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.553840] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.553899] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [10654.554019] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10654.554076] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [10654.593058] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.593215] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.593348] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.593482] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.593983] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.594210] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [10654.594325] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10654.594402] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [10654.594471] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [10654.594547] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 5/5 resources of Type:Security Group Rules [10654.594617] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGH for action security_group_rules [10654.594695] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGH for action security_group_rules [10654.594769] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGH for action security_group_rules [10654.594833] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_rules [10654.594894] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGH for action security_group_rules [10654.594969] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [10654.595050] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [10654.595235] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.595372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.595405] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.595536] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.595609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.595781] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.595880] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.595919] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.596062] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.596152] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.596294] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.596378] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.596433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.596561] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.596630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.596792] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.596878] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.596934] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.597075] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.597147] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.597309] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.597395] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.597453] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.597581] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.597652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.597812] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.597898] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.597955] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.598093] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.598166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.598326] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.598410] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.598468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.598595] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.598663] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.598821] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.598906] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.598960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.599101] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.599172] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.599332] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.599418] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.599476] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.599606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.599675] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.599835] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.599922] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.599979] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.600123] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.600189] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.600348] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.600434] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.600491] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.600619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.600687] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.600883] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.600989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.600989] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.601118] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.601191] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.601354] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.601441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.601496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.601621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.601691] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.601850] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.601937] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.601994] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.602138] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.602206] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.602366] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.602452] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.602503] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.602631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.602702] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.602859] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.602945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.603030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.603166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.603240] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.603403] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.603490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.603542] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.603670] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.603738] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.603901] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.603986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.604050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.604200] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.604275] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.604441] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.604528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.604585] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.604710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.604779] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.604940] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.605037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.605097] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.605232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.605296] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.605457] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.605543] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.605595] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.605722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.605791] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.605953] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.606051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.606110] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.606237] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.606306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.606467] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10654.606555] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10654.606619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10654.606733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10654.606799] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10654.606912] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:4 [10654.606958] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 4 of least updated resources [10654.607040] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGH for action security_group_members [10654.607127] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGH for action security_group_members [10654.607190] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGH for action security_group_members [10654.607256] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGH for action security_group_members [10654.607345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.756861] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10656.757251] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=9], Jobs=0 [10656.757251] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGH for action security_group_rules [10656.757251] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGH for action security_group_rules [10656.757369] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99711482-089a-4472-8ac3-fb1d995ba6dd with Priority: HIGH for action security_group_members [10656.757474] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1c2520-27f7-4185-a08f-749f3520871d with Priority: HIGH for action security_group_members [10656.757530] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 with Priority: HIGH for action security_group_members [10656.757619] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b696069c-81a6-4243-95fa-f24b214bded3 with Priority: HIGH for action security_group_members [10656.757728] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGH for action security_group_rules [10656.757804] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGH for action security_group_rules [10656.757899] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_rules [10656.758242] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.758374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.758438] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.758650] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.758732] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10656.759741] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.760334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.760334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.760334] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.760334] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10656.760982] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-99711482-089a-4472-8ac3-fb1d995ba6dd taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.761250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.761331] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.761498] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.761654] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.761751] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.761812] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.762133] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.762133] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.762133] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99711482-089a-4472-8ac3-fb1d995ba6dd',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10656.762914] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1c2520-27f7-4185-a08f-749f3520871d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.763379] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.763379] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.763379] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.763505] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.763656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.763809] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.763877] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.763952] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.764070] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa1c2520-27f7-4185-a08f-749f3520871d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10656.764895] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.765250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.765250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.765250] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.765396] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.765441] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.765472] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.765609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.765681] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.765760] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c59cdfc-cd95-45c8-bf65-8334d2d2cce6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10656.767037] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-b696069c-81a6-4243-95fa-f24b214bded3 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.767037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.767037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.767037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.767037] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.767037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.767037] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.767358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.767358] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.767358] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b696069c-81a6-4243-95fa-f24b214bded3',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10656.768023] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.768141] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.768141] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.768292] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.768357] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10656.769112] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.769207] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.769291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.769448] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.769524] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10656.770320] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.770420] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.770485] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.770656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.770728] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10656.796745] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.796949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.796949] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.797169] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.798746] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.798856] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.818023] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.818154] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e is going to be deleted. [10656.819047] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.819253] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.848108] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.848108] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa is going to be deleted. [10656.886250] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.886418] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.886482] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.886700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.886788] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.886913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.903699] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10656.903836] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10656.903901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10656.904162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10656.904249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10656.904361] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.272360] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.272524] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.272594] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.272822] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.272911] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.273174] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.273287] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.273402] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.273495] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.273570] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.273655] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa1c2520-27f7-4185-a08f-749f3520871d is going to be deleted. [10657.276108] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.276217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.276283] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.276431] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.276507] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.276664] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.276754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.276813] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.276945] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.277027] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.277115] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c59cdfc-cd95-45c8-bf65-8334d2d2cce6 is going to be deleted. [10657.277963] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.278104] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.278155] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.278372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.278474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.278640] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.278728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.278783] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.278919] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.278979] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.279079] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99711482-089a-4472-8ac3-fb1d995ba6dd is going to be deleted. [10657.281802] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.281925] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.281982] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.282139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.282218] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.282380] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.282465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.282516] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.282659] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.282731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.282809] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b696069c-81a6-4243-95fa-f24b214bded3 is going to be deleted. [10657.283618] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.283738] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.283797] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.283936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.284109] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.284213] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.284254] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.284392] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.284464] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.284541] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.284625] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10657.311916] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.312086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.312159] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.312373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.314067] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.314202] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.330137] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.330137] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.330411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.330411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.330497] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.332404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1c2520-27f7-4185-a08f-749f3520871d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.332404] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.332404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.332404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.332404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.332404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.332404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c59cdfc-cd95-45c8-bf65-8334d2d2cce6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.332785] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.332785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.332785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.332909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.332909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.332978] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99711482-089a-4472-8ac3-fb1d995ba6dd" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.336044] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.336151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.336238] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.336431] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.336513] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.336604] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b696069c-81a6-4243-95fa-f24b214bded3" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.347681] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.347813] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 is going to be deleted. [10657.348737] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.348938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.381173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.381293] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be deleted. [10657.405990] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.406164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.406231] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.406433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.406521] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.406633] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.448559] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10657.448632] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10657.448708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10657.448904] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10657.448996] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.449128] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10657.787442] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10658.289900] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685: rpc.has_security_group_logging(os_id): False [10658.311167] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10658.311344] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10658.311415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10658.311623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10658.356851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10658.357230] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10658.357362] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10658.357429] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10658.357641] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10658.357725] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10658.357814] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 is going to be updated. [10658.431890] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10658.432087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10658.432134] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10658.432586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10658.432586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10658.445829] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: IN_PROGRESS for 2s [10660.462620] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: SUCCESS [10660.463116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10661.758742] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10661.759110] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10666.760459] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10666.760459] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10668.520107] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ddc60fa7-1292-4b5c-9ee5-8d0a48e1bd56 None None] Enqueued Resource ID: 2ba9acea-e860-403f-b5af-14c0fd8dd50a with Priority: HIGHEST for action port [10668.520682] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba9acea-e860-403f-b5af-14c0fd8dd50a with Priority: HIGHEST for action port [10668.521067] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ba9acea-e860-403f-b5af-14c0fd8dd50a taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10668.521256] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ba9acea-e860-403f-b5af-14c0fd8dd50a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10668.521347] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ba9acea-e860-403f-b5af-14c0fd8dd50a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10668.521626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ba9acea-e860-403f-b5af-14c0fd8dd50a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10668.521748] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba9acea-e860-403f-b5af-14c0fd8dd50a',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10669.023993] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ba9acea-e860-403f-b5af-14c0fd8dd50a [10669.023993] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10669.024266] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10669.024922] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10669.024922] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10669.024922] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10669.024922] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ba9acea-e860-403f-b5af-14c0fd8dd50a already deleted. [10669.024922] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ba9acea-e860-403f-b5af-14c0fd8dd50a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10670.744202] env[65939]: INFO networking_nsxv3.common.synchronization [None req-93915ded-5c33-4d51-90da-6d4724dcb2d5 None None] Enqueued Resource ID: a23fa233-6307-4880-8757-85baa3f012a0 with Priority: HIGHEST for action port [10670.744202] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23fa233-6307-4880-8757-85baa3f012a0 with Priority: HIGHEST for action port [10670.744573] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-a23fa233-6307-4880-8757-85baa3f012a0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10670.744630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a23fa233-6307-4880-8757-85baa3f012a0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10670.744672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a23fa233-6307-4880-8757-85baa3f012a0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10670.744918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a23fa233-6307-4880-8757-85baa3f012a0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10670.744993] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a23fa233-6307-4880-8757-85baa3f012a0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10671.247218] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a23fa233-6307-4880-8757-85baa3f012a0 [10671.247522] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10671.247682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10671.247755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10671.247999] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10671.248244] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10671.248361] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a23fa233-6307-4880-8757-85baa3f012a0 already deleted. [10671.248458] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a23fa233-6307-4880-8757-85baa3f012a0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10675.745144] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10675.745484] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10680.746626] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10680.746944] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10682.307159] env[65939]: INFO networking_nsxv3.common.synchronization [None req-ee64d7a1-2702-4539-87af-1c9cd124a209 None None] Enqueued Resource ID: eb07794e-f25d-4d52-9b11-9bb6f760c79b with Priority: HIGHEST for action port [10682.307159] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb07794e-f25d-4d52-9b11-9bb6f760c79b with Priority: HIGHEST for action port [10682.307159] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb07794e-f25d-4d52-9b11-9bb6f760c79b taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10682.307159] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb07794e-f25d-4d52-9b11-9bb6f760c79b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10682.307159] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb07794e-f25d-4d52-9b11-9bb6f760c79b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10682.307621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb07794e-f25d-4d52-9b11-9bb6f760c79b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10682.307621] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb07794e-f25d-4d52-9b11-9bb6f760c79b',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10682.810627] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb07794e-f25d-4d52-9b11-9bb6f760c79b [10682.811658] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10682.811658] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10682.811658] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10682.811658] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10682.811893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10682.811893] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb07794e-f25d-4d52-9b11-9bb6f760c79b already deleted. [10682.811893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb07794e-f25d-4d52-9b11-9bb6f760c79b" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10684.554144] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b5f79f21-b8ac-4540-a151-81e66e6ea05c None None] Enqueued Resource ID: 7f07420f-8b81-450d-b24b-cb2f7d644853 with Priority: HIGHEST for action port [10684.554729] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f07420f-8b81-450d-b24b-cb2f7d644853 with Priority: HIGHEST for action port [10684.555058] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f07420f-8b81-450d-b24b-cb2f7d644853 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10684.555184] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f07420f-8b81-450d-b24b-cb2f7d644853" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10684.555253] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f07420f-8b81-450d-b24b-cb2f7d644853" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10684.555501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f07420f-8b81-450d-b24b-cb2f7d644853" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10684.555616] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f07420f-8b81-450d-b24b-cb2f7d644853',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10685.057918] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f07420f-8b81-450d-b24b-cb2f7d644853 [10685.058149] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10685.058273] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10685.058341] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10685.058548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10685.058633] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10685.058724] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f07420f-8b81-450d-b24b-cb2f7d644853 already deleted. [10685.058803] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f07420f-8b81-450d-b24b-cb2f7d644853" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10689.555410] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10689.555727] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10694.556461] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10694.556805] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10699.557307] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10699.557771] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10704.558704] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10704.559019] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10709.559807] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10709.560057] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10714.560983] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10714.561385] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10719.561735] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10719.562030] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10724.563472] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10724.563724] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10729.564292] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10729.564702] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10734.565008] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10734.565322] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10739.565676] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10739.565986] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10744.566847] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10744.566847] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10749.567346] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10749.567683] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10754.568438] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10754.568735] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10759.569165] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10759.569407] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10764.569812] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10764.570058] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10769.570650] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10769.571102] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10774.572216] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10774.572619] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10779.573877] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10779.574176] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10784.575822] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10784.576149] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10789.577893] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10789.577893] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10794.579369] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10794.579369] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10799.362283] env[65939]: INFO networking_nsxv3.common.synchronization [None req-818f93f7-a0b2-41dc-999c-c6154a6a6d6a None None] Enqueued Resource ID: ac8aaa98-c8bb-47d1-b04f-141dc466d19c with Priority: HIGHEST for action port [10799.362928] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac8aaa98-c8bb-47d1-b04f-141dc466d19c with Priority: HIGHEST for action port [10799.363314] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac8aaa98-c8bb-47d1-b04f-141dc466d19c taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10799.363444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac8aaa98-c8bb-47d1-b04f-141dc466d19c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10799.363505] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac8aaa98-c8bb-47d1-b04f-141dc466d19c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10799.363938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac8aaa98-c8bb-47d1-b04f-141dc466d19c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10799.364674] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac8aaa98-c8bb-47d1-b04f-141dc466d19c',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10799.871345] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac8aaa98-c8bb-47d1-b04f-141dc466d19c [10799.871345] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10799.871345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10799.871345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10799.871345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10799.871345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10799.871345] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac8aaa98-c8bb-47d1-b04f-141dc466d19c already deleted. [10799.871345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac8aaa98-c8bb-47d1-b04f-141dc466d19c" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10800.161836] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b673b13f-0c63-4a18-a458-2ce805fa8252 tempest-ServerActionsTestJSON-1122582292 tempest-ServerActionsTestJSON-1122582292-project-member] Enqueued Resource ID: 47c1d62e-c1cb-4cea-a84b-567f7d1622f9 with Priority: HIGHEST for action security_group_rules [10800.162715] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47c1d62e-c1cb-4cea-a84b-567f7d1622f9 with Priority: HIGHEST for action security_group_rules [10800.162760] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10800.162957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10800.162957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10800.163331] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10800.163331] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47c1d62e-c1cb-4cea-a84b-567f7d1622f9',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10800.249351] env[65939]: INFO networking_nsxv3.common.synchronization [None req-7b0dd80d-e4e2-4aa9-8e6b-9006fd03c711 tempest-ServerActionsTestJSON-1122582292 tempest-ServerActionsTestJSON-1122582292-project-member] Enqueued Resource ID: 47c1d62e-c1cb-4cea-a84b-567f7d1622f9 with Priority: HIGHEST for action security_group_rules [10800.249954] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47c1d62e-c1cb-4cea-a84b-567f7d1622f9 with Priority: HIGHEST for action security_group_rules [10800.250207] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10800.250309] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10800.689755] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10800.690195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10800.690195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10800.690314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10800.690373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10800.690467] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47c1d62e-c1cb-4cea-a84b-567f7d1622f9 already deleted. [10800.690578] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10800.690690] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10800.690841] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10800.690919] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47c1d62e-c1cb-4cea-a84b-567f7d1622f9',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10801.211548] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10801.211741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10801.211741] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10801.211973] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10801.212114] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10801.212238] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47c1d62e-c1cb-4cea-a84b-567f7d1622f9 already deleted. [10801.212345] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47c1d62e-c1cb-4cea-a84b-567f7d1622f9" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10801.514273] env[65939]: INFO networking_nsxv3.common.synchronization [None req-287b20a2-ae85-496c-bbad-6ec6e4969af4 None None] Enqueued Resource ID: 9d8f7280-f273-4167-b245-816cd392057f with Priority: HIGHEST for action port [10801.514835] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8f7280-f273-4167-b245-816cd392057f with Priority: HIGHEST for action port [10801.515336] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d8f7280-f273-4167-b245-816cd392057f taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10801.515336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d8f7280-f273-4167-b245-816cd392057f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10801.515336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d8f7280-f273-4167-b245-816cd392057f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10801.515621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d8f7280-f273-4167-b245-816cd392057f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10801.515692] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d8f7280-f273-4167-b245-816cd392057f',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10802.018119] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d8f7280-f273-4167-b245-816cd392057f [10802.019154] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10802.019154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10802.019154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10802.019154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10802.019154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10802.019154] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d8f7280-f273-4167-b245-816cd392057f already deleted. [10802.019154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d8f7280-f273-4167-b245-816cd392057f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10806.516591] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10806.516591] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10811.518019] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10811.518294] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10816.519060] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10816.519060] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10821.519992] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10821.520353] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10826.521256] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10826.521256] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10831.522145] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10831.522556] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10836.523324] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10836.523812] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10841.524268] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10841.524609] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10846.525776] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10846.526082] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10851.526652] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10851.527052] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10856.527918] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10856.528215] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10861.529360] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10861.529360] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10866.529896] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10866.530165] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10871.531284] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10871.531564] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10876.532456] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10876.532818] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10881.533662] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10881.533991] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10886.136916] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:42 completed [10886.137300] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:43 started [10886.534987] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10886.535121] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10891.536120] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10891.536623] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10892.058590] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10892.058813] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10892.058902] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10892.059221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10892.059339] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10892.561784] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10893.064311] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10893.591027] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [10893.591027] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [10894.401388] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.401610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.401610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.401808] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.551478] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [10894.552349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.553602] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [10894.578393] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.578630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.578630] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.578797] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.583436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.583812] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [10894.583898] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10894.583976] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [10894.611472] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.611838] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.611838] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.611928] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.612121] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.612270] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [10894.657275] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.657437] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.657437] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.657620] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.657790] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.657943] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [10894.703619] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.703825] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.703867] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.704125] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.704291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.704449] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:1. [10894.704525] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'53e4c22f-a8a1-4d6a-8ecc-2a114db2d685'} {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10894.704590] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [10894.723467] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.723667] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.723667] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.723864] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.723947] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.724095] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [10894.724211] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10894.724301] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [10894.774315] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.774534] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.774534] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.774714] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.775254] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.775430] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [10894.775506] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [10894.775575] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [10894.775658] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [10894.775739] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Security Group Rules [10894.775811] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_rules [10894.775889] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [10894.775947] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [10894.776189] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.776323] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.776427] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.776651] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.776787] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.777072] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.777221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.777326] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.777529] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.777660] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.777919] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.778072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.778166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.778376] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.778503] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.778729] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.778850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.778912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.779124] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.779206] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.779435] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.779569] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.779675] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.779832] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.779936] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.780184] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.780323] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.780426] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.780626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.780747] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.780998] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.781191] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.781268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.781477] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.781596] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.781821] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.781960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.782084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.782294] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.782421] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.782655] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.782762] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.782861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.783044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.783123] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.783353] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.783490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.783553] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.783717] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.783896] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.784144] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.784245] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.784306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.784444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.784553] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.784695] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.784792] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.784853] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.785042] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.785156] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.785391] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.785537] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.785652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.785837] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.785951] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.786190] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.786327] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.786423] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.786610] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.786696] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.786873] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.786966] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.787053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.787217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.787292] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.787461] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.787553] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.787619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.787755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.787830] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.788027] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.788103] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.788192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.788390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.788497] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.788748] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.788888] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.788963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.789119] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.789195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.789450] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.789575] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.789649] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.789754] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.789826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.789919] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [10894.790050] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [10894.790121] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [10894.834779] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.835024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.835024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.835204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.835372] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.835532] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [10894.877255] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10894.877452] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10894.877509] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10894.877708] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10894.877872] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10894.892222] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10896.537661] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10896.538138] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=1], Jobs=0 [10896.538138] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_rules [10896.538403] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10896.538565] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10896.538652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10896.538876] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10896.538952] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10897.041032] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10897.041234] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10897.041308] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10897.041487] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10897.041648] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10897.041745] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10897.041806] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10897.041948] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10897.042043] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10897.042129] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10897.042215] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10897.544985] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [10898.047980] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685: rpc.has_security_group_logging(os_id): False [10898.067325] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10898.067550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10898.067550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10898.067720] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10898.091214] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10898.091522] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10898.091641] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10898.091701] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10898.091901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10898.091986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10898.092089] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 is going to be updated. [10898.169540] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [10898.169540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [10898.169540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [10898.169540] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [10898.169780] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10898.185814] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: IN_PROGRESS for 2s [10900.200185] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: SUCCESS [10900.200526] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [10901.539350] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10901.539740] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10906.540695] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10906.541023] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10911.541834] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10911.542238] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10916.542938] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10916.543233] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10921.544319] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10921.544686] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10926.545699] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10926.545699] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10931.546726] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10931.547120] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10936.548357] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10936.548681] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10941.549889] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10941.550183] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10946.551121] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10946.551485] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10951.552577] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10951.552916] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10956.553466] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10956.553744] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10961.554698] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10961.555079] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10966.556229] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10966.556631] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10971.557046] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10971.557046] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10976.558094] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10976.558452] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10981.560947] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10981.561338] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10986.562168] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10986.562456] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10991.563626] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10991.563626] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [10996.565642] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [10996.566040] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11001.566759] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11001.567196] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11006.568225] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11006.568514] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11011.568918] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11011.569372] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11016.570568] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11016.570941] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11021.571704] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11021.571921] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11026.573130] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11026.573585] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11031.574019] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11031.574305] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11036.575216] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11036.575645] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11041.575964] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11041.576332] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11046.577204] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11046.577555] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11051.578065] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11051.578425] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11056.578963] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11056.579326] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11061.580532] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11061.580532] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11066.581565] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11066.581866] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11066.942617] env[65939]: INFO networking_nsxv3.common.synchronization [req-6472cf5d-595c-4e9b-ad2a-f1eaf0bcea0f req-82377159-01de-4056-a75b-cd0d765fb511 tempest-ServerActionsTestOtherA-1770217961 tempest-ServerActionsTestOtherA-1770217961-project-member] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_members [11066.943266] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGHEST for action security_group_members [11066.943631] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11066.943766] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11066.943833] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11066.944084] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11066.944263] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11066.944366] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11066.944429] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11066.944802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11066.944916] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11066.945038] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11067.448207] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11067.448394] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11067.448394] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11067.448652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11067.448719] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11067.448903] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11067.449000] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11067.449071] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11067.449224] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11067.449295] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11067.449378] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 is going to be updated. [11067.495355] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11067.495528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11067.495598] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11067.495815] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11067.495957] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11067.505659] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: IN_PROGRESS for 2s [11069.519792] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 in Status: SUCCESS [11069.520164] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 deletion is rescheduled due to dependency. [11069.520164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11071.943833] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11071.944172] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11076.945086] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11076.945420] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11081.946649] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11081.946649] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11086.947598] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11086.947987] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11091.948750] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11091.949124] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11096.950692] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11096.951040] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11101.952225] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11101.952551] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11106.953996] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11106.954384] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11111.955717] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11111.956072] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11116.957381] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11116.957717] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11121.958889] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11121.959275] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11126.137823] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:43 completed [11126.137823] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:44 started [11126.959685] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11126.959783] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11131.960812] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11131.961145] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11132.063701] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11132.063892] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11132.063892] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11132.064142] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11132.064253] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11132.566918] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11133.070859] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11133.573574] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [11133.573768] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [11134.319736] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.320098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.320098] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.320218] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.333088] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [11134.333931] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.334695] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [11134.359196] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.359391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.359391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.359591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.363973] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.364268] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [11134.364348] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11134.364427] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [11134.384498] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.384710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.384710] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.384881] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.385088] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.385209] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [11134.424641] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.424847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.424847] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.425048] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.425213] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.425374] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [11134.459131] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.459387] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.459387] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.459539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.459692] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.459847] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:1. [11134.459919] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'53e4c22f-a8a1-4d6a-8ecc-2a114db2d685'} {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11134.459987] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [11134.477299] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.477468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.477533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.477731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.477814] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.477920] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [11134.477990] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11134.478070] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [11134.509139] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.509387] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.509566] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.509764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.510270] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.510434] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [11134.510510] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11134.510596] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [11134.510660] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [11134.510737] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Security Group Rules [11134.510808] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_rules [11134.510888] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [11134.510948] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [11134.511161] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.511260] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.511322] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.511514] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.511591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.511765] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.511855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.511913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.512063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.512133] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.512298] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.512388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.512449] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.512586] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.512653] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.512817] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.512905] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.512962] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.513117] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.513173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.513337] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.513427] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.513484] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.513611] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.513679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.513854] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.513909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.513970] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.514134] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.514173] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.514333] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.514421] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.514478] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.514604] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.514673] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.514834] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.514919] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.514976] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.515116] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.515185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.515344] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.515433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.515491] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.515619] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.515686] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.515844] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.515930] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.515987] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.516128] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.516185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.516350] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.516435] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.516491] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.516617] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.516685] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.516841] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.516927] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.516982] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.517123] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.517192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.517353] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.517439] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.517496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.517620] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.517688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.517847] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.517934] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.517991] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.518132] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.518201] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.518382] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.518471] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.518527] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.518655] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.518723] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.518881] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.518966] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.519032] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.519161] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.519227] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.519409] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.519499] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.519556] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.519685] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.519753] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.519912] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11134.519998] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11134.520065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11134.520192] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11134.520262] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11134.520354] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:17 [11134.520420] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 17 of least updated resources [11134.520493] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGH for action security_group_members [11134.520568] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGH for action security_group_members [11134.520634] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGH for action security_group_members [11134.520698] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGH for action security_group_members [11134.520762] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGH for action security_group_members [11134.520824] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGH for action security_group_members [11134.520886] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGH for action security_group_members [11134.520947] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGH for action security_group_members [11134.521019] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGH for action security_group_members [11134.521081] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGH for action security_group_members [11134.521146] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGH for action security_group_members [11134.521208] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGH for action security_group_members [11134.521271] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGH for action security_group_members [11134.521335] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGH for action security_group_members [11134.521398] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGH for action security_group_members [11134.521461] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGH for action security_group_members [11134.521525] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGH for action security_group_members [11134.521613] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.962419] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11136.962786] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=18], Jobs=0 [11136.962786] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_rules [11136.962786] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa with Priority: HIGH for action security_group_members [11136.962873] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 with Priority: HIGH for action security_group_members [11136.962965] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 with Priority: HIGH for action security_group_members [11136.963075] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 with Priority: HIGH for action security_group_members [11136.963171] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5444fe-a221-4357-9950-de3a392af0b6 with Priority: HIGH for action security_group_members [11136.963261] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 with Priority: HIGH for action security_group_members [11136.963352] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d with Priority: HIGH for action security_group_members [11136.963444] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47963db-7b78-435b-9e39-5f259f042bf4 with Priority: HIGH for action security_group_members [11136.963532] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac3248a-183f-4532-817e-246814962f51 with Priority: HIGH for action security_group_members [11136.963620] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 with Priority: HIGH for action security_group_members [11136.963706] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e0845-02d8-4c70-8281-e3130037fa8e with Priority: HIGH for action security_group_members [11136.963793] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4415b353-eee7-421d-a222-35308d9d05b7 with Priority: HIGH for action security_group_members [11136.963880] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 with Priority: HIGH for action security_group_members [11136.963964] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee with Priority: HIGH for action security_group_members [11136.964061] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 with Priority: HIGH for action security_group_members [11136.964148] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 with Priority: HIGH for action security_group_members [11136.964235] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 with Priority: HIGH for action security_group_members [11136.964584] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.964716] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.964778] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.964985] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.965082] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.966095] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.966223] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.966306] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.966493] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.966638] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.966732] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.966791] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.966926] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.967014] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.967105] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f040ac16-496e-4b1e-b10a-6e1bc87cecaa',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.967884] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.967988] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.968091] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.968206] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.968580] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.968679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.968739] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.968878] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.968953] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.970251] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d8ad0b7-d8c7-421f-909b-f64756a0f7e0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.971040] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bc9971a-4944-4376-bed1-dab9f3b05345 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.971169] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.971211] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.971344] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.971679] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.971679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.971679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.971798] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.971798] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.971936] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bc9971a-4944-4376-bed1-dab9f3b05345',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.972577] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-152e138c-a16f-4ab1-ae1d-27177515f5d0 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.972682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.972733] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.972881] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.973020] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.973172] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.973249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.973388] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.973467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.973544] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152e138c-a16f-4ab1-ae1d-27177515f5d0',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.974613] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5444fe-a221-4357-9950-de3a392af0b6 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.974711] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.974803] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.974920] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.975066] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.975159] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.975227] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.975359] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.975446] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.975527] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5444fe-a221-4357-9950-de3a392af0b6',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.976238] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.976339] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.976400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.976542] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.976675] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.977021] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.977021] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.977081] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.977142] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.977223] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bb3e04f-6e66-47c4-8e1c-e6c56d139b32',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.978473] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.978473] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.978473] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.978635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.978635] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.978718] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.978772] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.978938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.979340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.979340] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4361c451-dad4-41c4-b71f-bbfd50f8ea0d',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.980017] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f47963db-7b78-435b-9e39-5f259f042bf4 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.980168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.980168] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.980235] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.980375] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.980467] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.980524] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.980656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.980728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.980807] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f47963db-7b78-435b-9e39-5f259f042bf4',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.981476] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac3248a-183f-4532-817e-246814962f51 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.981574] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.981620] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.981764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.981899] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.981991] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.982063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.982285] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.982390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.982438] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac3248a-183f-4532-817e-246814962f51',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.983244] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0f078-b1aa-4721-8b07-eb126a6fb449 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.983390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.983445] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.983546] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.983678] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.983769] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.983830] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.983963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.984045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.984122] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62f0f078-b1aa-4721-8b07-eb126a6fb449',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.984828] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e0845-02d8-4c70-8281-e3130037fa8e taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.984917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.985128] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.985128] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.985273] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.985365] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.985427] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.985559] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.985632] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.985836] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('333e0845-02d8-4c70-8281-e3130037fa8e',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.986401] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-4415b353-eee7-421d-a222-35308d9d05b7 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.986493] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.986528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.986672] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.986803] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.986893] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.986963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.987120] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.987284] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.987284] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4415b353-eee7-421d-a222-35308d9d05b7',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.987927] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-95cc14d0-8b63-4ace-a5e1-f800e80faf90 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.988032] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.988080] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.988224] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.989076] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.989076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.989076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.989076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.989076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.989076] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95cc14d0-8b63-4ace-a5e1-f800e80faf90',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.989980] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-f93f7997-4b3f-423d-a690-47bbfb3c31ee taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.989980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.989980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.989980] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.990209] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.990209] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.990209] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.990350] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.990350] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.990411] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f93f7997-4b3f-423d-a690-47bbfb3c31ee',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.991078] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed701299-54b2-4fb1-b7d6-f2f2b3925210 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.991184] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.991245] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.991415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.991558] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.991645] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.991705] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.991901] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.991985] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.992077] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed701299-54b2-4fb1-b7d6-f2f2b3925210',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.992737] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-71daec27-b0f6-4e1c-818d-ad3a56644326 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.992826] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.992869] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.993019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.993157] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.993249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.993307] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.993440] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.993513] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.993588] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71daec27-b0f6-4e1c-818d-ad3a56644326',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.994321] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0448a07-8b92-443f-84c4-39c4126ca3d2 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.994435] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.994491] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.994623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.994755] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.995200] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.995200] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.995200] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.995200] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.995200] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0448a07-8b92-443f-84c4-39c4126ca3d2',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11136.998562] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.998652] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.998725] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.998875] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.998950] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.999129] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11136.999220] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11136.999277] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11136.999797] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11136.999797] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11136.999797] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bc9971a-4944-4376-bed1-dab9f3b05345 is going to be deleted. [11137.000673] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.000810] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.000874] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.001030] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.001107] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.001268] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.001374] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.001436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.001571] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.001640] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.001739] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bb3e04f-6e66-47c4-8e1c-e6c56d139b32 is going to be deleted. [11137.002891] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.002994] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.003078] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.003217] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.003294] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.003478] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.003565] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.003624] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.003803] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.003848] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.003908] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f040ac16-496e-4b1e-b10a-6e1bc87cecaa is going to be deleted. [11137.004996] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.005390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.005390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.005390] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.005527] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.005573] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.005664] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.005725] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.005861] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.005937] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.006021] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d8ad0b7-d8c7-421f-909b-f64756a0f7e0 is going to be deleted. [11137.006922] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.007040] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.007106] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.007251] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.007328] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.007487] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.007576] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.007635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.007767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.007838] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.008425] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5444fe-a221-4357-9950-de3a392af0b6 is going to be deleted. [11137.044341] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.044528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.044528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.044704] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.065688] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.065830] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 is going to be deleted. [11137.080036] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.080243] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.080243] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.080440] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.080531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.080635] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d8ad0b7-d8c7-421f-909b-f64756a0f7e0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.081477] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.081596] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.081666] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.081834] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.081915] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.082013] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f040ac16-496e-4b1e-b10a-6e1bc87cecaa" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.082618] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.082727] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.082792] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.082938] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.083028] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.083118] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bc9971a-4944-4376-bed1-dab9f3b05345" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.083749] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.083855] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.083921] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.084083] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.084160] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.084246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bb3e04f-6e66-47c4-8e1c-e6c56d139b32" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.084858] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.084967] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.085044] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.085191] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.085269] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.085406] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5444fe-a221-4357-9950-de3a392af0b6" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.121297] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.121530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.121600] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.121767] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.121850] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.121975] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.497315] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.497490] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.497533] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.497757] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.497843] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.498051] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.498148] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.498210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.498396] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.498468] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.498555] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4361c451-dad4-41c4-b71f-bbfd50f8ea0d is going to be deleted. [11137.499641] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.499755] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.499822] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.499971] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.500080] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.500231] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.500325] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.500387] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.500522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.500594] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.500676] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 333e0845-02d8-4c70-8281-e3130037fa8e is going to be deleted. [11137.501571] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.501682] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.501761] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.501909] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.501986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.502158] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.502249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.502340] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.502445] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.502517] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.502597] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed701299-54b2-4fb1-b7d6-f2f2b3925210 is going to be deleted. [11137.503389] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.503496] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.503561] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.503700] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.503772] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.503926] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.504026] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.504087] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.504219] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.504289] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.504371] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152e138c-a16f-4ab1-ae1d-27177515f5d0 is going to be deleted. [11137.505148] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.505249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.505314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.505457] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.505532] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.505691] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.505781] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.505842] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.506080] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.506080] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.506164] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac3248a-183f-4532-817e-246814962f51 is going to be deleted. [11137.506883] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.506997] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.507076] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.507221] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.507298] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.507460] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.507555] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.507627] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.507783] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.507856] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.507940] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95cc14d0-8b63-4ace-a5e1-f800e80faf90 is going to be deleted. [11137.508764] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.508860] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.508930] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.509125] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.509208] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.509338] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.509458] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.509503] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.509626] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.509698] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.509778] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f93f7997-4b3f-423d-a690-47bbfb3c31ee is going to be deleted. [11137.510608] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.510715] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.510780] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.510920] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.510996] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.511166] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.511255] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.511315] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.511452] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.511535] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.511638] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f47963db-7b78-435b-9e39-5f259f042bf4 is going to be deleted. [11137.512449] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.512557] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.512636] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.512758] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.512851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.512979] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.513086] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.513157] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.513290] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.513363] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.513453] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71daec27-b0f6-4e1c-818d-ad3a56644326 is going to be deleted. [11137.514221] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.514323] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.514386] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.514528] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.514674] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.514756] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.514846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.514897] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.515047] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.515125] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.515214] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4415b353-eee7-421d-a222-35308d9d05b7 is going to be deleted. [11137.518816] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.518941] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.518996] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.519154] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.519229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.519432] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.519530] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.519591] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.519734] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.519804] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.519887] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62f0f078-b1aa-4721-8b07-eb126a6fb449 is going to be deleted. [11137.521082] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.521187] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.521249] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.521403] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.521472] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.521639] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.521722] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.521785] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.521924] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.521995] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.522091] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0448a07-8b92-443f-84c4-39c4126ca3d2 is going to be deleted. [11137.565034] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.565329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.565446] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.565783] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.565939] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.566109] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed701299-54b2-4fb1-b7d6-f2f2b3925210" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.567382] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.567558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.567673] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.567944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.568104] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.568273] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71daec27-b0f6-4e1c-818d-ad3a56644326" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.569271] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.569456] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.569570] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.569817] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.569963] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.570146] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f47963db-7b78-435b-9e39-5f259f042bf4" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.571094] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.571263] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.571382] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.571623] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.571749] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.571895] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f93f7997-4b3f-423d-a690-47bbfb3c31ee" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.572740] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.572917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.573050] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.573291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.573434] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.573594] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152e138c-a16f-4ab1-ae1d-27177515f5d0" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.574438] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.574612] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.574735] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.574966] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.575119] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.575268] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac3248a-183f-4532-817e-246814962f51" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.576139] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.576299] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.576415] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.576656] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.576798] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.576960] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4361c451-dad4-41c4-b71f-bbfd50f8ea0d" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.577881] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.578068] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.578190] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.578442] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.578581] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.578728] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0448a07-8b92-443f-84c4-39c4126ca3d2" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.579649] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.579805] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.579912] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.580197] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.580302] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.580462] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0f078-b1aa-4721-8b07-eb126a6fb449" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.581388] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.581560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.581683] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.581917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.582081] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.582242] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95cc14d0-8b63-4ace-a5e1-f800e80faf90" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.582978] env[65939]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [11137.583554] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.583730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.583838] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.584118] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.584254] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.584404] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e0845-02d8-4c70-8281-e3130037fa8e" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.585288] env[65939]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [11137.585963] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11137.586182] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11137.586291] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11137.586523] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11137.586659] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11137.586802] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4415b353-eee7-421d-a222-35308d9d05b7" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11141.965451] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11141.965848] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11146.966670] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11146.966936] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11151.968278] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11151.968569] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11156.969593] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11156.969876] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11161.970802] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11161.971320] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11166.972150] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11166.972550] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11171.973947] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11171.973947] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11176.975115] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11176.975483] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11181.976308] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11181.976635] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11186.977850] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11186.978217] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11191.979136] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11191.979531] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11196.980737] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11196.981124] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11201.981723] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11201.982101] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11206.983377] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11206.983746] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11211.985047] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11211.985628] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11216.986384] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11216.986648] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11221.988705] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11221.988705] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11226.989830] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11226.990223] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11231.991091] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11231.991091] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11236.992062] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11236.992549] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11241.993153] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11241.993559] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11246.994647] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11246.994988] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11251.996178] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11251.996686] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11256.997314] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11256.997659] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11261.998134] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11261.998472] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11266.999675] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11267.000090] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11272.000795] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11272.001201] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11277.001594] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11277.001879] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11282.002503] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11282.002969] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11287.003909] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11287.004335] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11292.004767] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11292.005111] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11297.005769] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11297.006169] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11302.006859] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11302.007244] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11307.007836] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11307.008182] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11312.009347] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11312.009620] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11317.010686] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11317.011100] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11322.011813] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11322.012158] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11327.013248] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11327.013531] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11332.014144] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11332.014477] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11337.015079] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11337.015635] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11342.016868] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11342.017404] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11347.018127] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11347.018609] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11352.018798] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11352.019171] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11357.020396] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11357.020855] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11362.022053] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11362.022419] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11366.138890] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:44 completed [11366.139575] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:45 started [11367.023663] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11367.023826] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11372.025500] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11372.026095] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11372.062591] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11372.062804] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11372.062804] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11372.063058] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11372.063179] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11372.565997] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11373.068619] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11373.571850] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [11373.571850] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [11374.443861] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.444267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.444267] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.444381] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.458796] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [11374.459762] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.460618] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [11374.486325] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.486465] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.486531] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.486745] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.491310] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.491602] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [11374.491681] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11374.491758] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [11374.512634] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.512775] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.512846] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.513045] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.513185] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.513308] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [11374.534421] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.534608] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.534651] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.534821] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.534929] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.535058] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [11374.556348] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.556713] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.556816] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.557051] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.557196] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.557348] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [11374.557446] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11374.557540] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [11374.574437] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.574653] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.574724] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.574937] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.575096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.575169] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [11374.575242] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11374.575299] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [11374.597834] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.598024] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.598083] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.598264] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.598409] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.598535] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [11374.598605] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11374.598670] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [11374.598733] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [11374.598816] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [11374.598887] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [11374.598943] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [11374.599121] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.599226] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.599272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.599422] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.599493] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.599581] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [11374.599636] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [11374.599703] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [11374.626587] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.626789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.626789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.626942] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.627059] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.627179] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [11374.650031] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11374.650031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11374.650031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11374.650031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11374.650031] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11374.661243] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11377.026592] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11377.027042] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11382.027788] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11382.028121] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11386.039538] env[65939]: INFO networking_nsxv3.common.synchronization [None req-2448670d-9679-4499-9441-f6a546d3ad15 None None] Enqueued Resource ID: af2a350d-360c-4a5c-b39f-a9483ab32926 with Priority: HIGHEST for action port [11386.040077] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af2a350d-360c-4a5c-b39f-a9483ab32926 with Priority: HIGHEST for action port [11386.040385] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-af2a350d-360c-4a5c-b39f-a9483ab32926 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11386.040489] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af2a350d-360c-4a5c-b39f-a9483ab32926" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11386.040554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af2a350d-360c-4a5c-b39f-a9483ab32926" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11386.040789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af2a350d-360c-4a5c-b39f-a9483ab32926" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11386.040872] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af2a350d-360c-4a5c-b39f-a9483ab32926',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11386.543679] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af2a350d-360c-4a5c-b39f-a9483ab32926 [11386.543929] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11386.544075] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11386.544195] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11386.544424] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11386.544513] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11386.544612] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af2a350d-360c-4a5c-b39f-a9483ab32926 already deleted. [11386.544694] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af2a350d-360c-4a5c-b39f-a9483ab32926" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11386.842110] env[65939]: INFO networking_nsxv3.common.synchronization [None req-23c1d88b-8227-4b93-8742-0074469572ff tempest-AttachVolumeShelveTestJSON-285981902 tempest-AttachVolumeShelveTestJSON-285981902-project-member] Enqueued Resource ID: 2b09d316-a1a9-4326-9a0d-8129e9088ceb with Priority: HIGHEST for action security_group_rules [11386.842541] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b09d316-a1a9-4326-9a0d-8129e9088ceb with Priority: HIGHEST for action security_group_rules [11386.842849] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11386.842983] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11386.843066] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11386.843314] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11386.843417] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b09d316-a1a9-4326-9a0d-8129e9088ceb',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11386.925397] env[65939]: INFO networking_nsxv3.common.synchronization [None req-225d0702-84f3-42d9-95cc-39cdab4fa373 tempest-AttachVolumeShelveTestJSON-285981902 tempest-AttachVolumeShelveTestJSON-285981902-project-member] Enqueued Resource ID: 2b09d316-a1a9-4326-9a0d-8129e9088ceb with Priority: HIGHEST for action security_group_rules [11386.925892] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b09d316-a1a9-4326-9a0d-8129e9088ceb with Priority: HIGHEST for action security_group_rules [11386.926199] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11386.926520] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11387.366522] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11387.366522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11387.366522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11387.366522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11387.366522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11387.366522] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b09d316-a1a9-4326-9a0d-8129e9088ceb already deleted. [11387.366522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11387.366522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11387.366522] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11387.366522] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b09d316-a1a9-4326-9a0d-8129e9088ceb',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11387.887115] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11387.887958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11387.887958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11387.887958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11387.887958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11387.887958] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b09d316-a1a9-4326-9a0d-8129e9088ceb already deleted. [11387.887958] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b09d316-a1a9-4326-9a0d-8129e9088ceb" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11388.224291] env[65939]: INFO networking_nsxv3.common.synchronization [None req-e40a6409-4a0d-46da-adf9-267b175ad836 None None] Enqueued Resource ID: 205274a7-0df9-4428-9309-01edb96dfc1a with Priority: HIGHEST for action port [11388.224545] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 205274a7-0df9-4428-9309-01edb96dfc1a with Priority: HIGHEST for action port [11388.224853] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock port-205274a7-0df9-4428-9309-01edb96dfc1a taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11388.224973] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-205274a7-0df9-4428-9309-01edb96dfc1a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11388.225053] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-205274a7-0df9-4428-9309-01edb96dfc1a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11388.225307] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-205274a7-0df9-4428-9309-01edb96dfc1a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11388.225418] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('205274a7-0df9-4428-9309-01edb96dfc1a',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11388.727254] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 205274a7-0df9-4428-9309-01edb96dfc1a [11388.727491] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11388.727609] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11388.727679] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11388.727917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11388.728059] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11388.728131] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:205274a7-0df9-4428-9309-01edb96dfc1a already deleted. [11388.728213] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-205274a7-0df9-4428-9309-01edb96dfc1a" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11393.225241] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11393.225608] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11398.226806] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11398.227187] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11403.228436] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11403.228838] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11408.230306] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11408.230665] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11413.231423] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11413.231677] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11418.232557] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11418.232873] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11423.234600] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11423.234921] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11428.236517] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11428.236517] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11433.237322] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11433.237691] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11438.238450] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11438.238799] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11443.239067] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11443.239455] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11448.240598] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11448.241096] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11453.241841] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11453.242254] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11458.243432] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11458.243788] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11463.244825] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11463.244825] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11468.245512] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11468.245782] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11473.246449] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11473.246816] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11478.247547] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11478.247924] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11483.249007] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11483.249266] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11488.250267] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11488.250267] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11493.251678] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11493.252055] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11498.252746] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11498.253150] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11503.254544] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11503.254910] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11508.256372] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11508.256688] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11513.258270] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11513.258633] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11518.260178] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11518.260575] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11523.262150] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11523.262494] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11528.263467] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11528.263848] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11533.265468] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11533.265835] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11538.267104] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11538.267446] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11543.269279] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11543.269279] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11548.270151] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11548.270559] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11553.272079] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11553.272432] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11558.273965] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11558.274361] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11563.275127] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11563.275528] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11568.276631] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11568.277045] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11573.278389] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11573.278758] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11578.279699] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11578.279989] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11583.280892] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11583.281302] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11584.369295] env[65939]: INFO networking_nsxv3.common.synchronization [None req-bd01da72-5444-4635-8354-43aade8515f0 tempest-AttachVolumeShelveTestJSON-285981902 tempest-AttachVolumeShelveTestJSON-285981902-project-member] Enqueued Resource ID: 1bd4379d-7110-4420-87a7-ae2fb5834d8f with Priority: HIGHEST for action security_group_rules [11584.369763] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd4379d-7110-4420-87a7-ae2fb5834d8f with Priority: HIGHEST for action security_group_rules [11584.370104] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11584.370229] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11584.370288] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11584.370554] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11584.370632] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bd4379d-7110-4420-87a7-ae2fb5834d8f',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11584.446739] env[65939]: INFO networking_nsxv3.common.synchronization [None req-b222114b-0aeb-4599-b28a-34a20f0d2fea tempest-AttachVolumeShelveTestJSON-285981902 tempest-AttachVolumeShelveTestJSON-285981902-project-member] Enqueued Resource ID: 1bd4379d-7110-4420-87a7-ae2fb5834d8f with Priority: HIGHEST for action security_group_rules [11584.446739] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd4379d-7110-4420-87a7-ae2fb5834d8f with Priority: HIGHEST for action security_group_rules [11584.446936] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11584.447046] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11584.900065] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11584.900065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11584.900065] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11584.900330] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11584.900373] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11584.900472] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bd4379d-7110-4420-87a7-ae2fb5834d8f already deleted. [11584.900555] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11584.901075] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11584.901266] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11584.901342] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bd4379d-7110-4420-87a7-ae2fb5834d8f',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11585.420235] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11585.420606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11585.420606] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11585.420677] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11585.420707] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11585.420803] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bd4379d-7110-4420-87a7-ae2fb5834d8f already deleted. [11585.420953] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bd4379d-7110-4420-87a7-ae2fb5834d8f" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11589.447359] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11589.447655] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11594.448542] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11594.448936] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11599.449725] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11599.450038] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11604.450762] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11604.451141] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11606.139866] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:45 completed [11606.140327] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:46 started [11609.452274] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11609.452705] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11612.062218] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11612.062529] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11612.062529] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11612.062676] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11612.062783] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11612.565373] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11613.068115] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11613.570320] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [11613.570507] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [11614.311917] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11614.311917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11614.311917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11614.311917] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11614.324570] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [11614.325410] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11614.326156] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [11614.350398] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11614.350631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11614.350631] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11614.350813] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11614.355189] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11614.355465] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [11614.355543] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11614.355621] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [11614.374830] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11614.374986] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11614.375057] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11614.375225] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11614.375351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11614.375458] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [11614.396065] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11614.396246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11614.396246] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11614.396444] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11614.396550] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11614.396661] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [11614.419153] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11614.419329] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11614.419391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11614.419551] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11614.419657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11614.419778] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [11614.419849] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11614.419916] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [11614.437131] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11614.437313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11614.437313] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11614.437517] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11614.437602] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11614.437709] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [11614.437778] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11614.437845] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [11614.453179] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11614.453295] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11614.456748] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11614.456876] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11614.456941] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11614.457172] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11614.457333] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11614.457454] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [11614.457524] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11614.457590] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [11614.457653] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [11614.457733] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [11614.457796] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [11614.457855] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [11614.458049] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , >, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11614.458151] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11614.458210] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11614.458364] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11614.458436] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11614.458525] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:1 [11614.458587] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 1 of least updated resources [11614.458664] env[65939]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_members [11614.458761] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11619.454274] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11619.454692] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=1], Jobs=0 [11619.454692] env[65939]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 with Priority: HIGH for action security_group_members [11619.454934] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 taken with stack trace [, , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11619.455096] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11619.455164] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11619.455375] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11619.455532] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11619.455634] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11619.455696] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11619.455841] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11619.455923] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11619.456031] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53e4c22f-a8a1-4d6a-8ecc-2a114db2d685',) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11619.960326] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11619.960549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11619.960549] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11619.960764] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11619.960851] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11619.961060] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11619.961162] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11619.961224] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11619.961370] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11619.961443] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11619.961529] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53e4c22f-a8a1-4d6a-8ecc-2a114db2d685 is going to be deleted. [11619.990898] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11619.991145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11619.991145] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11619.991299] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11619.991382] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11619.991474] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53e4c22f-a8a1-4d6a-8ecc-2a114db2d685" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11624.455515] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11624.455875] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11629.456829] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11629.457218] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11634.458859] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11634.459264] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11639.460260] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11639.460666] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11644.461872] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11644.461872] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11649.463331] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11649.463733] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11654.465610] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11654.465610] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11659.466926] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11659.467301] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11664.468453] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11664.468822] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11669.469583] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11669.469583] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11674.470854] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11674.471308] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11679.472243] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11679.472612] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11684.474207] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11684.474643] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11689.476046] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11689.476474] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11694.477351] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11694.477776] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11699.478512] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11699.478855] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11704.479998] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11704.480317] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11709.481634] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11709.481988] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11714.482603] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11714.483030] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11719.483875] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11719.484301] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11724.485293] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11724.485590] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11729.486164] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11729.486512] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11734.487760] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11734.487760] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11739.489331] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11739.489729] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11744.490901] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11744.491266] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11749.491782] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11749.492114] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11754.492995] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11754.493428] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11759.494374] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11759.494738] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11764.495776] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11764.496171] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11769.497576] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11769.498073] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11774.498975] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11774.498975] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11779.499865] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11779.500331] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11784.501502] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11784.501502] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11789.502600] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11789.502967] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11794.504050] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11794.504441] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11799.504999] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11799.505380] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11804.506629] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11804.507142] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11809.507323] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11809.507323] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11814.509108] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11814.509522] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11819.510058] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11819.510423] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11824.511738] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11824.512229] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11829.513314] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11829.513314] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11834.514684] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11834.514684] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11839.515729] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11839.516496] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11844.516877] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11844.517335] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11846.141142] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:46 completed [11846.141553] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:47 started [11849.518477] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11849.519071] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11852.060592] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11852.061069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11852.061069] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11852.061191] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11852.061266] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11852.563735] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11853.066920] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [11853.569148] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [11853.569341] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [11854.317832] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11854.318336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11854.318336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11854.318336] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11854.330764] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [11854.331593] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.332367] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [11854.355167] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11854.355351] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11854.355391] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11854.355560] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11854.360042] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.360326] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [11854.360410] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11854.360490] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [11854.379904] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11854.380119] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11854.380119] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11854.380294] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11854.380423] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.380530] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [11854.400537] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11854.400723] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11854.400723] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11854.400918] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11854.401032] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.401149] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [11854.419736] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11854.419887] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11854.419922] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11854.420139] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11854.420241] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.420356] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [11854.420425] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11854.420493] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [11854.439303] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11854.439492] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11854.439492] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11854.439692] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11854.439777] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.439887] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [11854.439957] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11854.440038] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [11854.459516] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11854.459670] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11854.459731] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11854.459896] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11854.459996] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.460126] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [11854.460195] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [11854.460261] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [11854.460324] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [11854.460397] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [11854.460457] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [11854.460512] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [11854.460583] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [11854.460634] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [11854.460696] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [11854.481038] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11854.481194] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11854.481232] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11854.481433] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11854.481539] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.481646] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [11854.501545] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [11854.501740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [11854.501740] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [11854.501944] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [11854.502063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.513683] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [11854.520080] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11854.520223] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11859.521597] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11859.522045] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11864.522880] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11864.523313] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11869.524148] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11869.524632] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11874.525518] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11874.525911] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11879.527019] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11879.527489] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11884.528399] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11884.528860] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11889.529417] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11889.529907] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11894.530753] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11894.531613] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11899.532441] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11899.532852] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11904.534067] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11904.534067] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11909.534933] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11909.535349] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11914.536459] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11914.536846] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11919.537310] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11919.537697] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11924.538703] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11924.539139] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11929.539448] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11929.539874] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11934.540363] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11934.540980] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11939.542086] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11939.542520] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11944.542795] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11944.543562] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11949.544337] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11949.544746] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11954.546064] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11954.546064] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11959.546570] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11959.546978] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11964.547763] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11964.548232] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11969.548400] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11969.548859] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11974.549263] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11974.549679] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11979.550018] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11979.551364] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11984.550783] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11984.551269] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11989.552518] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11989.552518] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11994.553612] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11994.554095] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [11999.554680] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [11999.554680] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12004.555960] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12004.556397] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12009.556753] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12009.557175] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12014.557879] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12014.558352] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12019.559832] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12019.560263] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12024.563261] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12024.563777] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12029.564174] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12029.564713] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12034.566101] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12034.566550] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12039.567798] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12039.568266] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12044.569055] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12044.569517] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12049.570548] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12049.570978] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12054.572176] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12054.572625] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12059.573494] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12059.573864] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12064.574593] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12064.575789] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12069.576042] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12069.576457] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12074.577469] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12074.577881] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12079.579267] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12079.579267] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12084.580418] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12084.580418] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12086.141985] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:47 completed [12086.142440] env[65939]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-953bb993-9beb-4133-bce0-1b086a741268 None None] NSXv3 Agent Agent loop - iteration:48 started [12089.581723] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12089.582806] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12092.065653] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12092.066137] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12092.066137] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12092.066272] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12092.066317] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [12092.568779] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [12093.071421] env[65939]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65939) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:77}} [12093.574296] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [12093.574558] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [12094.368998] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12094.369411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12094.369411] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12094.369478] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12094.382317] env[65939]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [12094.383157] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12094.384116] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [12094.409748] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12094.409933] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12094.411501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12094.411501] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12094.414657] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12094.414974] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [12094.415069] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [12094.415145] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [12094.441256] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12094.441400] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12094.441461] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12094.441664] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12094.441796] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12094.441905] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [12094.469063] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12094.469063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12094.469063] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12094.469277] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12094.469380] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12094.469453] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [12094.488408] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12094.488558] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12094.488621] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12094.488815] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12094.488913] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12094.489067] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [12094.489141] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [12094.489214] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [12094.507928] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12094.508088] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12094.508166] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12094.508349] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12094.508507] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12094.508546] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [12094.508596] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [12094.508665] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [12094.532637] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12094.532789] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12094.532860] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12094.533072] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12094.533179] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12094.533308] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [12094.533383] env[65939]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65939) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [12094.533434] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [12094.533498] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [12094.533580] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [12094.533687] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [12094.533687] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [12094.533788] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [12094.533826] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [12094.533857] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [12094.558862] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12094.559066] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12094.559204] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12094.559318] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12094.559425] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12094.559536] env[65939]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [12094.581337] env[65939]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65939) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [12094.581548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [12094.581548] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [12094.581730] env[65939]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [12094.581833] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12094.582806] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12094.582890] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12094.593019] env[65939]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65939) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [12099.584544] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12099.584919] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12104.585745] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12104.586138] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12109.587443] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12109.587839] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12114.589065] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12114.589533] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12119.589955] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12119.590392] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12124.591129] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12124.591573] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12129.592321] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12129.592776] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12134.593612] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12134.595293] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12139.595431] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12139.595880] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12144.597356] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12144.599392] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12149.599032] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12149.599401] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12154.599838] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12154.600208] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12159.601594] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12159.602079] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12164.603348] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12164.603748] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12169.604409] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12169.604835] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12174.606208] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12174.606677] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12179.607927] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12179.608313] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12184.609263] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12184.609671] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12189.610873] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12189.610873] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12194.611629] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12194.612065] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12199.613066] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12199.613468] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [12204.614528] env[65939]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [12204.614845] env[65939]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0