[ 691.623388] env[70879]: INFO neutron.common.config [-] Logging enabled! [ 691.623734] env[70879]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev16 [ 691.623909] env[70879]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70879) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} [ 691.624222] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 691.624322] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 691.625200] env[70879]: WARNING oslo_policy.policy [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 691.625422] env[70879]: WARNING oslo_policy.policy [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 691.626954] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] VMware NSXv3 Agent initialized successfully. [ 691.627329] env[70879]: DEBUG oslo_concurrency.lockutils [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] Acquiring lock "singleton_lock" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.627468] env[70879]: DEBUG oslo_concurrency.lockutils [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] Acquired lock "singleton_lock" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.627692] env[70879]: DEBUG oslo_concurrency.lockutils [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] Releasing lock "singleton_lock" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 691.627970] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] Full set of CONF: {{(pid=70879) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} [ 691.628101] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ******************************************************************************** {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 691.628212] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] Configuration options gathered from: {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 691.628540] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2808}} [ 691.628720] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 691.628842] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ================================================================================ {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2811}} [ 691.629068] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] agent_down_time = 75 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.629192] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] allow_automatic_dhcp_failover = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.629336] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] allow_bulk = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.629487] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] api_extensions_path = {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.629633] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] api_paste_config = api-paste.ini {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.629782] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] auth_strategy = keystone {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.629895] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] backdoor_port = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.630017] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] backdoor_socket = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.630162] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] backlog = 4096 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.630308] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] base_mac = fa:16:3e:00:00:00 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.630464] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] bind_host = 0.0.0.0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.630614] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] bind_port = 9696 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.630759] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] client_socket_timeout = 900 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.630906] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] config_dir = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.631035] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.631182] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] config_source = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.631329] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] control_exchange = neutron {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.631476] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] core_plugin = ml2 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.631621] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] debug = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.631765] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] default_availability_zones = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.631979] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.632140] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] dhcp_agent_notification = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.632284] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] dhcp_agents_per_network = 1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.632427] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] dhcp_lease_duration = 86400 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.632586] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] dhcp_load_type = networks {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.632764] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] dns_domain = openstacklocal {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.632913] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.633065] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] enable_default_route_bfd = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.633205] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] enable_default_route_ecmp = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.633342] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] enable_dvr = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.633479] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] enable_new_agents = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.633615] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.633764] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] enable_signals = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.633896] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] enable_traditional_dhcp = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.634042] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] external_dns_driver = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.634182] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] filter_validation = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.634330] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] global_physnet_mtu = 8950 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.634470] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] graceful_shutdown_timeout = 60 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.634656] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] host = cpu-1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.634802] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] host_dvr_for_dhcp = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.634942] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] http_retries = 3 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.635097] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] instance_format = [instance: %(uuid)s] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.635243] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.635385] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ipam_driver = internal {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.635532] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ipv6_pd_enabled = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.635655] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] l3_ha = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.635799] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.635939] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] l3_ha_network_physical_name = {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.636088] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] l3_ha_network_type = {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.636234] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] log_color = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.636377] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] log_config_append = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.636534] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.636684] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] log_dir = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.636825] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] log_file = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.636936] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] log_options = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.637087] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] log_rotate_interval = 1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.637237] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] log_rotate_interval_type = days {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.637381] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] log_rotation_type = none {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.637504] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.637620] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.637760] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.637904] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.638021] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.638165] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] max_dns_nameservers = 5 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.638306] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] max_header_line = 16384 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.638444] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] max_l3_agents_per_router = 3 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.638582] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] max_logfile_count = 30 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.638720] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] max_logfile_size_mb = 200 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.638874] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] max_subnet_host_routes = 20 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.639042] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] my_ip = 10.180.1.21 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.639190] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] my_ipv6 = ::1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.639331] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] network_auto_schedule = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.639466] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] network_link_prefix = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.639610] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.639762] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] notify_nova_on_port_data_changes = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.639902] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] notify_nova_on_port_status_changes = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.640055] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] pagination_max_limit = -1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.640195] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] publish_errors = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.640331] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] rate_limit_burst = 0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.640475] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] rate_limit_except_level = CRITICAL {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.640614] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] rate_limit_interval = 0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.640754] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] retry_until_window = 30 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.640890] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] router_distributed = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.641037] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] rpc_resources_processing_step = 20 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.641177] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] rpc_response_max_timeout = 600 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.641318] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] rpc_response_timeout = 60 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.641455] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] send_events_interval = 2 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.641611] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] service_plugins = ['router'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.641768] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] setproctitle = on {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.641938] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] shell_completion = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.642107] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] state_path = /opt/stack/data/neutron {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.642255] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] syslog_log_facility = LOG_USER {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.642398] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] tcp_keepidle = 600 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.642544] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] transport_url = **** {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.642687] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] use_eventlog = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.642826] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] use_journal = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.642965] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] use_json = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.643114] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] use_ssl = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.643251] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] use_stderr = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.643395] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] use_syslog = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.643533] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] vlan_transparent = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.643672] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] watch_log_file = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.643812] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] wsgi_default_pool_size = 100 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.643951] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] wsgi_keep_alive = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.644108] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.644249] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] wsgi_server_debug = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2819}} [ 691.644421] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.644621] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.644841] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.645110] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.645391] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.645656] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.645915] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.646128] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.connection_string = messaging:// {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.646295] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.enabled = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.646455] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.es_doc_type = notification {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.646633] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.es_scroll_size = 10000 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.646799] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.es_scroll_time = 2m {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.646950] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.filter_error_trace = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.647115] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.hmac_keys = **** {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.647268] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.sentinel_service_name = mymaster {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.647422] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.socket_timeout = 0.1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.647568] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.trace_requests = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.647712] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler.trace_sqlalchemy = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.647873] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler_jaeger.process_tags = {} {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.648026] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.648174] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] profiler_otlp.service_name_prefix = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.648332] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.enforce_new_defaults = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.648621] env[70879]: WARNING oslo_config.cfg [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 691.648783] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.enforce_scope = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.649025] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.policy_default_rule = default {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.649224] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.649386] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.649543] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.649691] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.649833] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.649977] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.650135] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.650293] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.650451] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] agent.extensions = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.650603] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.650758] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] service_providers.service_provider = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.650913] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.default_quota = -1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.651079] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.651228] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.quota_floatingip = 50 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.651372] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.quota_network = 100 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.651517] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.quota_port = 500 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.651661] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.651805] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.quota_router = 10 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.651949] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.quota_security_group = 10 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.652105] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.652249] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.quota_subnet = 100 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.652389] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] QUOTAS.track_quota_usage = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.652551] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.652694] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep.group = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.652863] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep.helper_command = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.652979] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.653136] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep.thread_pool_size = 8 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.653280] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep.user = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.653433] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.653574] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_dhcp_release.group = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.653715] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_dhcp_release.helper_command = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.653858] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.654005] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.654151] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_dhcp_release.user = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.654300] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.654468] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_ovs_vsctl.group = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.654669] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_ovs_vsctl.helper_command = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.654830] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.654979] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.655135] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_ovs_vsctl.user = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.655286] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_namespace.capabilities = [21] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.655424] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_namespace.group = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.655562] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_namespace.helper_command = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.655787] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.655852] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_namespace.thread_pool_size = 8 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.655989] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_namespace.user = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.656152] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_conntrack.capabilities = [12] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.656291] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_conntrack.group = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.656427] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_conntrack.helper_command = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.656603] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.656755] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.656897] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_conntrack.user = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.657061] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_link.capabilities = [12, 21] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.657203] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_link.group = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.657340] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_link.helper_command = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.657487] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.657631] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_link.thread_pool_size = 8 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.657799] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] privsep_link.user = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.657982] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.658153] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.658301] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.continue_on_failed_promotions = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.658442] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.dscp = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.658585] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.dscp_inherit = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.658737] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.force_mp_to_policy = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.658878] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.locking_coordinator_url = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.659032] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.log_agent_heartbeats = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.659181] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.logging_expire = 1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.659333] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.659480] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.659634] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.polling_interval = 240 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.659780] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.659930] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.660092] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.report_interval = 30.0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.660244] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.660391] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.660551] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.660702] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.sync_skew = 60 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.660847] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.synchronization_queue_size = 20 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.660990] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT.use_helper_for_ns_read = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.661156] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] SECURITYGROUP.enable_ipset = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.661307] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] SECURITYGROUP.enable_security_group = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.661458] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.661610] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.661764] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] experimental.ipv6_pd_enabled = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.661947] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] experimental.linuxbridge = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.662135] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ml2.extension_drivers = ['port_security'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.662283] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ml2.external_network_type = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.662444] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.662587] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ml2.overlay_ip_version = 4 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.662738] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ml2.path_mtu = 8950 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.662887] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ml2.physical_network_mtus = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.663050] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ml2.tenant_network_types = ['vlan'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.663200] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.663351] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ml2.type_drivers = ['vlan'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.663505] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT_CLI.neutron_port_id = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.663648] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.663794] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.663944] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.664106] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.664257] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.664414] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.664608] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.664759] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.664965] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.665132] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_login_password = **** {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.665290] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_login_port = 443 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.665439] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_login_user = admin {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.665592] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.665745] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.665911] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.666044] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.666199] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.666353] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.666538] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.666710] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.666866] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.667030] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.667190] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.667337] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.667488] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.667682] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.667837] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] vsphere.vsphere_login_password = VMware1! {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.667985] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.668141] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.668293] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.auth_section = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.668445] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.auth_type = password {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.668592] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.668735] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.certfile = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.668879] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.collect_timing = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.669041] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.endpoint_type = public {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.669186] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.insecure = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.669326] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.keyfile = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.669473] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.region_name = RegionOne {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.669651] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.split_loggers = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.669832] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] nova.timeout = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.669987] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.auth_section = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.670153] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.auth_type = password {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.670303] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.670445] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.certfile = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.670588] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.collect_timing = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.670739] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.endpoint_type = public {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.670880] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.insecure = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.671025] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.keyfile = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.671167] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.region_name = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.671307] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.split_loggers = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.671444] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] placement.timeout = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.671593] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.auth_section = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.671737] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.auth_type = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.671875] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.cafile = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.672023] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.certfile = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.672235] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.collect_timing = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.672396] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.connect_retries = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.672542] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.connect_retry_delay = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.672688] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.enable_notifications = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.672828] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.endpoint_override = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.672971] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.insecure = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.673127] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.interface = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.673267] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.keyfile = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.673405] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.max_version = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.673544] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.min_version = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.673682] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.region_name = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.673820] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.retriable_status_codes = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.673956] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.service_name = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.674104] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.service_type = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.674249] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.split_loggers = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.674389] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.status_code_retries = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.674556] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.status_code_retry_delay = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.674694] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.timeout = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.674837] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.valid_interfaces = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.674978] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ironic.version = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.675142] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] cli_script.dry_run = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.675304] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.675446] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.675592] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.675735] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.675875] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.676038] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.676166] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.676306] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.676446] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.676629] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.676779] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.676932] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.677093] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.677248] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.677398] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.677569] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.677724] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.677880] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.678034] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.678178] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.678326] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.678474] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.678618] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.678768] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.678937] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.679099] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.679247] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.679391] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.679540] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.679688] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.ssl = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.679843] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.679993] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.680149] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.680302] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.680449] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.680593] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.680754] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_notifications.driver = [] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.680900] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.681130] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.681297] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2826}} [ 691.681413] env[70879]: DEBUG oslo_service.service [None req-b0220cd9-5907-4c67-9546-68e9a64ac0c1 None None] ******************************************************************************** {{(pid=70879) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2830}} [ 691.682479] env[70879]: DEBUG neutron.agent.securitygroups_rpc [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Init firewall settings (driver=nsxv3) {{(pid=70879) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:124}} [ 691.683828] env[70879]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70879) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 691.684061] env[70879]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] RPC agent_id: nsxm-l-01a.corp.local [ 691.686156] env[70879]: DEBUG dogpile.cache.region [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] No value present for key: 'zone-id' {{(pid=70879) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.686272] env[70879]: DEBUG dogpile.lock [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] NeedRegenerationException {{(pid=70879) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.686374] env[70879]: DEBUG dogpile.lock [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] no value, waiting for create lock {{(pid=70879) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.686470] env[70879]: DEBUG dogpile.lock [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] value creation lock acquired {{(pid=70879) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.686591] env[70879]: DEBUG dogpile.cache.region [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] No value present for key: 'zone-id' {{(pid=70879) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.686687] env[70879]: DEBUG dogpile.lock [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Calling creation function for not-yet-present value {{(pid=70879) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.686810] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.807556] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Session token - acquiring [ 691.809166] env[70879]: DEBUG networking_nsxv3.common.locking [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.809352] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 691.809429] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.809864] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 691.819975] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 692.094633] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 692.118196] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.118350] env[70879]: DEBUG dogpile.cache.region [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Cache value generated in 0.432 seconds for key(s): 'zone-id' {{(pid=70879) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 692.118456] env[70879]: DEBUG dogpile.lock [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Released creation lock {{(pid=70879) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.118581] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Activating Policy API Provider. [ 692.118774] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Looking for the default Infrastructure Rules. [ 692.183126] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Looking for the Default Layer3 Logged Drop Section. [ 692.198885] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 692.199315] env[70879]: DEBUG networking_nsxv3.common.locking [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.199490] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquiring lock "all" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 692.199598] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired lock "all" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.199884] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired external semaphore "all" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 692.200243] env[70879]: DEBUG networking_nsxv3.api.rpc [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.715799] env[70879]: DEBUG networking_nsxv3.api.rpc [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.218682] env[70879]: DEBUG networking_nsxv3.api.rpc [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.721207] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Inventory metadata is going to be refreshed. [ 693.721407] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 694.470603] env[70879]: DEBUG networking_nsxv3.common.locking [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.470977] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquiring lock "Segment" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.471145] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired lock "Segment" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.471409] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired external semaphore "Segment" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.483696] env[70879]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 694.484619] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Releasing lock "Segment" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.485351] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 694.505724] env[70879]: DEBUG networking_nsxv3.common.locking [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.505995] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.505995] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.506305] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.506434] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.506658] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 694.506787] env[70879]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70879) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 694.506897] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 694.526442] env[70879]: DEBUG networking_nsxv3.common.locking [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.526706] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.526776] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.527075] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.527254] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.527397] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 694.550700] env[70879]: DEBUG networking_nsxv3.common.locking [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.550951] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.551137] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.551420] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.551573] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.551791] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 694.573059] env[70879]: DEBUG networking_nsxv3.common.locking [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.573335] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquiring lock "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.573335] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired lock "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.573662] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired external semaphore "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.573809] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Releasing lock "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.573968] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 694.574089] env[70879]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70879) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 694.574198] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 694.592938] env[70879]: DEBUG networking_nsxv3.common.locking [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.593234] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquiring lock "Segment QoS" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.593234] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired lock "Segment QoS" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.593548] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired external semaphore "Segment QoS" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.593675] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Releasing lock "Segment QoS" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.593828] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 694.593933] env[70879]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70879) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 694.594055] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 694.615461] env[70879]: DEBUG networking_nsxv3.common.locking [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.615739] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquiring lock "Security Group (Members)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 694.615827] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired lock "Security Group (Members)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.616196] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Acquired external semaphore "Security Group (Members)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 694.616376] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Releasing lock "Security Group (Members)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.616588] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 694.616706] env[70879]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70879) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 694.616847] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Inventory metadata have been refreshed. [ 694.616957] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Dryrun:True. Metadata refresh completed. [ 694.617123] env[70879]: DEBUG oslo_concurrency.lockutils [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Releasing lock "all" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 694.618981] env[70879]: INFO neutron.agent.agent_extensions_manager [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Loaded agent extensions: [] [ 694.619807] env[70879]: DEBUG neutron_lib.callbacks.manager [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70879) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 694.677854] env[70879]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] NSXv3 Agent Agent RPC Daemon Started! [ 694.678054] env[70879]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] NSXv3 Agent Agent loop - iteration:0 started [ 694.678106] env[70879]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] NSXv3 Agent Agent out of sync with plugin! [ 699.620748] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 699.620748] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 704.621659] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 704.622151] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 708.368689] env[70879]: INFO networking_nsxv3.common.synchronization [None req-4118fd8e-b317-484e-9eae-be5f3ec33dff demo admin] Enqueued Resource ID: 5a8786f4-d387-45c6-af2d-8970ca10076a with Priority: HIGHEST for action security_group_rules [ 708.369232] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8786f4-d387-45c6-af2d-8970ca10076a with Priority: HIGHEST for action security_group_rules [ 708.369527] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a8786f4-d387-45c6-af2d-8970ca10076a taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.369647] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a8786f4-d387-45c6-af2d-8970ca10076a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.369720] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a8786f4-d387-45c6-af2d-8970ca10076a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.370111] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a8786f4-d387-45c6-af2d-8970ca10076a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.370207] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a8786f4-d387-45c6-af2d-8970ca10076a',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.890888] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.891128] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 708.891128] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.891346] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 708.891428] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 708.891528] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a8786f4-d387-45c6-af2d-8970ca10076a already deleted. [ 708.891611] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a8786f4-d387-45c6-af2d-8970ca10076a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 713.370234] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 713.370473] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 718.371262] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 718.371625] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 721.623255] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.623702] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 721.623702] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.623702] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 721.623926] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.127142] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.629556] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.132675] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 723.132914] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 723.372150] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 723.372402] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 723.943178] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.943567] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.943567] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.943657] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.955790] env[70879]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 723.956595] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.957413] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 723.976006] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.976226] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.976226] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.976437] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.976522] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.976634] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 723.976707] env[70879]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70879) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 723.976778] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 723.997510] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.997735] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 723.997800] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.998110] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 723.998308] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 723.998470] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 724.019392] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.019600] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.019600] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.019804] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.019910] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.020041] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 724.040831] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.041029] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.041079] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.041274] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.041377] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.041502] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 724.041577] env[70879]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70879) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 724.042214] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 724.059816] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.060028] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.060028] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.060262] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.060393] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.060440] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 724.060498] env[70879]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70879) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 724.060566] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 724.080400] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.080633] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.080633] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.080800] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.080901] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.081027] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 724.081103] env[70879]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70879) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 724.081170] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 724.081233] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 724.081319] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 724.081383] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 724.081447] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 724.081695] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 724.081760] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 724.081829] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 724.101358] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.101622] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.101622] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.101774] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.101873] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.101986] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 724.123917] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.124158] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 724.124158] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.124339] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 724.124471] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 724.136570] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 728.376584] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 728.376584] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 733.377982] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 733.378284] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 737.786203] env[70879]: INFO networking_nsxv3.common.synchronization [None req-6b46a614-d788-4a0b-9f84-58378f9a163d None None] Enqueued Resource ID: 6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4 with Priority: HIGHEST for action port [ 737.786718] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4 with Priority: HIGHEST for action port [ 737.787070] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.787353] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 737.787353] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.787524] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 737.787621] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.290778] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4 [ 738.291191] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.292141] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 738.293861] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.293861] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 738.293861] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 738.293861] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4 already deleted. [ 738.293861] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c2cbd4c-8a61-44ea-bf1e-c84ec77266e4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.289311] env[70879]: INFO networking_nsxv3.common.synchronization [None req-405189df-31ca-4376-8760-074d6e79c25a None None] Enqueued Resource ID: 48919a76-83c0-4ffd-9b4d-37b97848ff42 with Priority: HIGHEST for action port [ 739.289311] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48919a76-83c0-4ffd-9b4d-37b97848ff42 with Priority: HIGHEST for action port [ 739.291414] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-48919a76-83c0-4ffd-9b4d-37b97848ff42 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.291414] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48919a76-83c0-4ffd-9b4d-37b97848ff42" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.291414] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48919a76-83c0-4ffd-9b4d-37b97848ff42" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.291583] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48919a76-83c0-4ffd-9b4d-37b97848ff42" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.291583] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48919a76-83c0-4ffd-9b4d-37b97848ff42',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.795676] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48919a76-83c0-4ffd-9b4d-37b97848ff42 [ 739.795903] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.796063] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 739.796134] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.796361] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 739.796446] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 739.796539] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48919a76-83c0-4ffd-9b4d-37b97848ff42 already deleted. [ 739.796618] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48919a76-83c0-4ffd-9b4d-37b97848ff42" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 740.775707] env[70879]: INFO networking_nsxv3.common.synchronization [None req-5b8dfa86-a273-43d6-8369-d3d7f90322a9 None None] Enqueued Resource ID: e9e9aea6-90a5-4b01-a091-3d403f085bb4 with Priority: HIGHEST for action port [ 740.775707] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9e9aea6-90a5-4b01-a091-3d403f085bb4 with Priority: HIGHEST for action port [ 740.775707] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9e9aea6-90a5-4b01-a091-3d403f085bb4 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.775707] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9e9aea6-90a5-4b01-a091-3d403f085bb4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 740.775707] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9e9aea6-90a5-4b01-a091-3d403f085bb4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.776249] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9e9aea6-90a5-4b01-a091-3d403f085bb4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 740.776249] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e9aea6-90a5-4b01-a091-3d403f085bb4',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.275146] env[70879]: INFO networking_nsxv3.common.synchronization [None req-4bf3f1ac-4b02-4757-b270-4d545aad0c73 None None] Enqueued Resource ID: 1e0a1db7-26cc-48d7-9ef1-ac112778cf8f with Priority: HIGHEST for action port [ 741.275146] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e0a1db7-26cc-48d7-9ef1-ac112778cf8f with Priority: HIGHEST for action port [ 741.275367] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e0a1db7-26cc-48d7-9ef1-ac112778cf8f taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.275573] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e0a1db7-26cc-48d7-9ef1-ac112778cf8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.275573] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e0a1db7-26cc-48d7-9ef1-ac112778cf8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.275866] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e0a1db7-26cc-48d7-9ef1-ac112778cf8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.275866] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e0a1db7-26cc-48d7-9ef1-ac112778cf8f',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.280142] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9e9aea6-90a5-4b01-a091-3d403f085bb4 [ 741.280760] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.280760] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.280760] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.280760] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.280760] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.281095] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9e9aea6-90a5-4b01-a091-3d403f085bb4 already deleted. [ 741.281095] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9e9aea6-90a5-4b01-a091-3d403f085bb4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.765644] env[70879]: INFO networking_nsxv3.common.synchronization [None req-7b5825da-fa53-43e0-a22a-1446c4b5a84e None None] Enqueued Resource ID: e0d0ca41-140a-438a-ae64-5adacc1c0a5d with Priority: HIGHEST for action port [ 741.765903] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d0ca41-140a-438a-ae64-5adacc1c0a5d with Priority: HIGHEST for action port [ 741.766699] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0d0ca41-140a-438a-ae64-5adacc1c0a5d taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.769336] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0d0ca41-140a-438a-ae64-5adacc1c0a5d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.769507] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0d0ca41-140a-438a-ae64-5adacc1c0a5d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.770268] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0d0ca41-140a-438a-ae64-5adacc1c0a5d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.770377] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0d0ca41-140a-438a-ae64-5adacc1c0a5d',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.780224] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e0a1db7-26cc-48d7-9ef1-ac112778cf8f [ 741.780224] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.780224] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 741.780224] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.780224] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 741.780224] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 741.780224] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e0a1db7-26cc-48d7-9ef1-ac112778cf8f already deleted. [ 741.780224] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e0a1db7-26cc-48d7-9ef1-ac112778cf8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.274083] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0d0ca41-140a-438a-ae64-5adacc1c0a5d [ 742.274351] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.274498] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 742.274561] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.274770] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 742.274862] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 742.274958] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0d0ca41-140a-438a-ae64-5adacc1c0a5d already deleted. [ 742.275087] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0d0ca41-140a-438a-ae64-5adacc1c0a5d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.123779] env[70879]: INFO networking_nsxv3.common.synchronization [None req-da085deb-458d-4e12-82f7-79402fd2b334 None None] Enqueued Resource ID: d11a84b3-ce44-40fe-bec9-ddcf5365710e with Priority: HIGHEST for action port [ 743.124055] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11a84b3-ce44-40fe-bec9-ddcf5365710e with Priority: HIGHEST for action port [ 743.124613] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-d11a84b3-ce44-40fe-bec9-ddcf5365710e taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.124736] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d11a84b3-ce44-40fe-bec9-ddcf5365710e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.124805] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d11a84b3-ce44-40fe-bec9-ddcf5365710e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.125253] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d11a84b3-ce44-40fe-bec9-ddcf5365710e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.125354] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d11a84b3-ce44-40fe-bec9-ddcf5365710e',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.628032] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d11a84b3-ce44-40fe-bec9-ddcf5365710e [ 743.628289] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.628423] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.628490] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.628761] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.628830] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.628866] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d11a84b3-ce44-40fe-bec9-ddcf5365710e already deleted. [ 743.628947] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d11a84b3-ce44-40fe-bec9-ddcf5365710e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 743.780478] env[70879]: INFO networking_nsxv3.common.synchronization [None req-d2c5d739-d5e3-483c-83de-5329c8d92a26 None None] Enqueued Resource ID: 047ef6a8-1240-4698-8f7c-1ec1575d01da with Priority: HIGHEST for action port [ 743.780478] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047ef6a8-1240-4698-8f7c-1ec1575d01da with Priority: HIGHEST for action port [ 743.780746] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-047ef6a8-1240-4698-8f7c-1ec1575d01da taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.780806] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-047ef6a8-1240-4698-8f7c-1ec1575d01da" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 743.780873] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-047ef6a8-1240-4698-8f7c-1ec1575d01da" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.781120] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-047ef6a8-1240-4698-8f7c-1ec1575d01da" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 743.781194] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('047ef6a8-1240-4698-8f7c-1ec1575d01da',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.172455] env[70879]: INFO networking_nsxv3.common.synchronization [None req-999b427c-d0b8-4c9e-9928-bcfd5bb64844 None None] Enqueued Resource ID: a0f28744-5ed7-489f-a7dc-f9e8aecebbc3 with Priority: HIGHEST for action port [ 744.172455] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0f28744-5ed7-489f-a7dc-f9e8aecebbc3 with Priority: HIGHEST for action port [ 744.172455] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0f28744-5ed7-489f-a7dc-f9e8aecebbc3 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.172455] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0f28744-5ed7-489f-a7dc-f9e8aecebbc3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.172455] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0f28744-5ed7-489f-a7dc-f9e8aecebbc3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.172455] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0f28744-5ed7-489f-a7dc-f9e8aecebbc3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.172455] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0f28744-5ed7-489f-a7dc-f9e8aecebbc3',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.287318] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 047ef6a8-1240-4698-8f7c-1ec1575d01da [ 744.288103] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.288103] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.288103] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.288103] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.288103] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.288103] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:047ef6a8-1240-4698-8f7c-1ec1575d01da already deleted. [ 744.288103] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-047ef6a8-1240-4698-8f7c-1ec1575d01da" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.630691] env[70879]: INFO networking_nsxv3.common.synchronization [None req-b291eb45-4db0-40e0-b7e2-ca907ba31843 None None] Enqueued Resource ID: 7e3c1091-1f30-49c8-8916-3c6a044cb817 with Priority: HIGHEST for action port [ 744.630691] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e3c1091-1f30-49c8-8916-3c6a044cb817 with Priority: HIGHEST for action port [ 744.630691] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e3c1091-1f30-49c8-8916-3c6a044cb817 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.630691] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e3c1091-1f30-49c8-8916-3c6a044cb817" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.630691] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e3c1091-1f30-49c8-8916-3c6a044cb817" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.637382] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e3c1091-1f30-49c8-8916-3c6a044cb817" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.637535] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e3c1091-1f30-49c8-8916-3c6a044cb817',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.678434] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0f28744-5ed7-489f-a7dc-f9e8aecebbc3 [ 744.678654] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.678791] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 744.678865] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.679102] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 744.679198] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 744.682275] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0f28744-5ed7-489f-a7dc-f9e8aecebbc3 already deleted. [ 744.682391] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0f28744-5ed7-489f-a7dc-f9e8aecebbc3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.143140] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e3c1091-1f30-49c8-8916-3c6a044cb817 [ 745.146016] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.146016] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.146016] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.146016] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.146016] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.146016] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e3c1091-1f30-49c8-8916-3c6a044cb817 already deleted. [ 745.146016] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e3c1091-1f30-49c8-8916-3c6a044cb817" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.228690] env[70879]: INFO networking_nsxv3.common.synchronization [None req-a1c0467d-97e9-4fb7-b9e5-59c985fb927d None None] Enqueued Resource ID: 49ad056c-3f3f-4f83-9321-952754b25a63 with Priority: HIGHEST for action port [ 745.229011] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49ad056c-3f3f-4f83-9321-952754b25a63 with Priority: HIGHEST for action port [ 745.236264] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-49ad056c-3f3f-4f83-9321-952754b25a63 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.236264] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49ad056c-3f3f-4f83-9321-952754b25a63" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.236264] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49ad056c-3f3f-4f83-9321-952754b25a63" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.236264] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49ad056c-3f3f-4f83-9321-952754b25a63" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.236264] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49ad056c-3f3f-4f83-9321-952754b25a63',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.738670] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49ad056c-3f3f-4f83-9321-952754b25a63 [ 745.739041] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.739189] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 745.739256] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.739483] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 745.739599] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 745.739711] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49ad056c-3f3f-4f83-9321-952754b25a63 already deleted. [ 745.745591] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49ad056c-3f3f-4f83-9321-952754b25a63" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.441332] env[70879]: INFO networking_nsxv3.common.synchronization [None req-e3384743-2b67-4fdf-8dc0-2bde3abfc8c0 None None] Enqueued Resource ID: aee01713-3b21-49c5-b53d-b69012e73db6 with Priority: HIGHEST for action port [ 746.441771] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee01713-3b21-49c5-b53d-b69012e73db6 with Priority: HIGHEST for action port [ 746.442219] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-aee01713-3b21-49c5-b53d-b69012e73db6 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.442346] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aee01713-3b21-49c5-b53d-b69012e73db6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.442472] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aee01713-3b21-49c5-b53d-b69012e73db6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.442651] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aee01713-3b21-49c5-b53d-b69012e73db6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.442858] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee01713-3b21-49c5-b53d-b69012e73db6',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.945841] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aee01713-3b21-49c5-b53d-b69012e73db6 [ 746.946439] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.947976] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 746.947976] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.947976] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 746.947976] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 746.947976] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aee01713-3b21-49c5-b53d-b69012e73db6 already deleted. [ 746.947976] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aee01713-3b21-49c5-b53d-b69012e73db6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.409415] env[70879]: INFO networking_nsxv3.common.synchronization [None req-7383e363-5f8b-461c-ba02-7effb06d50bc tempest-ServersTestJSON-1801177295 tempest-ServersTestJSON-1801177295-project-member] Enqueued Resource ID: 98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca with Priority: HIGHEST for action security_group_rules [ 747.409415] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca with Priority: HIGHEST for action security_group_rules [ 747.409415] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.409415] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.409415] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.410765] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.410765] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.613024] env[70879]: INFO networking_nsxv3.common.synchronization [None req-ac1a03e2-cafc-4621-8fb6-04e6d42aa7d8 tempest-ServersTestJSON-1801177295 tempest-ServersTestJSON-1801177295-project-member] Enqueued Resource ID: 98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca with Priority: HIGHEST for action security_group_rules [ 747.613408] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca with Priority: HIGHEST for action security_group_rules [ 747.613702] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.613804] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.843008] env[70879]: INFO networking_nsxv3.common.synchronization [None req-0526aa17-efa3-4d44-ab1d-751cd97c52c8 None None] Enqueued Resource ID: 00efc7b0-dcb5-442b-b93c-5039975a9078 with Priority: HIGHEST for action port [ 747.843420] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00efc7b0-dcb5-442b-b93c-5039975a9078 with Priority: HIGHEST for action port [ 747.843613] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-00efc7b0-dcb5-442b-b93c-5039975a9078 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.843722] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00efc7b0-dcb5-442b-b93c-5039975a9078" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.843787] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00efc7b0-dcb5-442b-b93c-5039975a9078" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.844978] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00efc7b0-dcb5-442b-b93c-5039975a9078" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.845130] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00efc7b0-dcb5-442b-b93c-5039975a9078',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.937833] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.938227] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 747.938227] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.938305] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.938377] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.938474] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca already deleted. [ 747.938560] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 747.938748] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.941092] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 747.941321] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.349435] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00efc7b0-dcb5-442b-b93c-5039975a9078 [ 748.349681] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.349844] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.349907] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.350126] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.350221] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.350321] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00efc7b0-dcb5-442b-b93c-5039975a9078 already deleted. [ 748.350402] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00efc7b0-dcb5-442b-b93c-5039975a9078" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.435105] env[70879]: INFO networking_nsxv3.common.synchronization [None req-498674d5-3ce4-4374-a34c-f726de68cbea None None] Enqueued Resource ID: c545ebb4-1414-4c3d-9df9-6014d4dc23c2 with Priority: HIGHEST for action port [ 748.435339] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c545ebb4-1414-4c3d-9df9-6014d4dc23c2 with Priority: HIGHEST for action port [ 748.435892] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-c545ebb4-1414-4c3d-9df9-6014d4dc23c2 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.436049] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c545ebb4-1414-4c3d-9df9-6014d4dc23c2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.436121] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c545ebb4-1414-4c3d-9df9-6014d4dc23c2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.436368] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c545ebb4-1414-4c3d-9df9-6014d4dc23c2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.437457] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c545ebb4-1414-4c3d-9df9-6014d4dc23c2',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.461021] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.461213] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.461274] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.461500] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.461586] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.461636] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca already deleted. [ 748.461713] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98c21d6e-90a1-4b0d-a4b4-f1abc49c9fca" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.582954] env[70879]: INFO networking_nsxv3.common.synchronization [None req-45af51de-8d3b-4f06-b2cc-31f7ed65ea27 None None] Enqueued Resource ID: 0cc5e375-e665-4979-8af6-fcdb6339b9bf with Priority: HIGHEST for action port [ 748.583167] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc5e375-e665-4979-8af6-fcdb6339b9bf with Priority: HIGHEST for action port [ 748.583613] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cc5e375-e665-4979-8af6-fcdb6339b9bf taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.583740] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cc5e375-e665-4979-8af6-fcdb6339b9bf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.583809] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cc5e375-e665-4979-8af6-fcdb6339b9bf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.584065] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cc5e375-e665-4979-8af6-fcdb6339b9bf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.584758] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cc5e375-e665-4979-8af6-fcdb6339b9bf',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.939736] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c545ebb4-1414-4c3d-9df9-6014d4dc23c2 [ 748.940102] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.940102] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 748.940226] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.940395] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 748.940483] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 748.940577] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c545ebb4-1414-4c3d-9df9-6014d4dc23c2 already deleted. [ 748.940658] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c545ebb4-1414-4c3d-9df9-6014d4dc23c2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.090971] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cc5e375-e665-4979-8af6-fcdb6339b9bf [ 749.090971] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.090971] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.090971] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.091199] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.091199] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.091284] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cc5e375-e665-4979-8af6-fcdb6339b9bf already deleted. [ 749.091363] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cc5e375-e665-4979-8af6-fcdb6339b9bf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.257264] env[70879]: INFO networking_nsxv3.common.synchronization [None req-b6716013-0946-40a0-82e7-ed511adafab7 None None] Enqueued Resource ID: 50f495ab-338d-484e-8fd1-48d7366a72c5 with Priority: HIGHEST for action port [ 749.257520] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f495ab-338d-484e-8fd1-48d7366a72c5 with Priority: HIGHEST for action port [ 749.258106] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f495ab-338d-484e-8fd1-48d7366a72c5 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.258236] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f495ab-338d-484e-8fd1-48d7366a72c5" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.258307] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f495ab-338d-484e-8fd1-48d7366a72c5" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.258560] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f495ab-338d-484e-8fd1-48d7366a72c5" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.258647] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f495ab-338d-484e-8fd1-48d7366a72c5',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.761041] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50f495ab-338d-484e-8fd1-48d7366a72c5 [ 749.761342] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.761528] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 749.761624] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.761809] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 749.761872] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 749.762417] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50f495ab-338d-484e-8fd1-48d7366a72c5 already deleted. [ 749.762417] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f495ab-338d-484e-8fd1-48d7366a72c5" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 752.589373] env[70879]: INFO networking_nsxv3.common.synchronization [None req-8627a2e3-c724-4dfa-9078-d1193f988d46 None None] Enqueued Resource ID: ec53fb6d-913a-4ba3-8a0a-7f1f70522b75 with Priority: HIGHEST for action port [ 752.590042] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec53fb6d-913a-4ba3-8a0a-7f1f70522b75 with Priority: HIGHEST for action port [ 752.591979] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec53fb6d-913a-4ba3-8a0a-7f1f70522b75 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.591979] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec53fb6d-913a-4ba3-8a0a-7f1f70522b75" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.591979] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec53fb6d-913a-4ba3-8a0a-7f1f70522b75" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.591979] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec53fb6d-913a-4ba3-8a0a-7f1f70522b75" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.591979] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec53fb6d-913a-4ba3-8a0a-7f1f70522b75',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.801890] env[70879]: INFO networking_nsxv3.common.synchronization [None req-7d609417-47c0-4ed4-ba7e-33ada08f4cf5 None None] Enqueued Resource ID: 4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29 with Priority: HIGHEST for action port [ 752.801890] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29 with Priority: HIGHEST for action port [ 752.801890] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.801890] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 752.801890] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.801890] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 752.801890] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.096653] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec53fb6d-913a-4ba3-8a0a-7f1f70522b75 [ 753.096653] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.096653] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.096653] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.096653] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.096653] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.096653] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec53fb6d-913a-4ba3-8a0a-7f1f70522b75 already deleted. [ 753.096653] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec53fb6d-913a-4ba3-8a0a-7f1f70522b75" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.302982] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29 [ 753.303367] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.303594] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 753.303762] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.304047] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 753.304212] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 753.304935] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29 already deleted. [ 753.304935] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a2c9baa-f17f-4dd2-b9c3-3e08c0f37f29" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.405169] env[70879]: INFO networking_nsxv3.common.synchronization [None req-60a6a086-34d9-4b05-96f9-0fdac57a0d31 None None] Enqueued Resource ID: b7927038-4f39-41ce-9b48-a3904071922b with Priority: HIGHEST for action port [ 756.405949] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7927038-4f39-41ce-9b48-a3904071922b with Priority: HIGHEST for action port [ 756.405949] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7927038-4f39-41ce-9b48-a3904071922b taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.410521] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7927038-4f39-41ce-9b48-a3904071922b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.410521] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7927038-4f39-41ce-9b48-a3904071922b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.410521] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7927038-4f39-41ce-9b48-a3904071922b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.410521] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7927038-4f39-41ce-9b48-a3904071922b',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.913598] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7927038-4f39-41ce-9b48-a3904071922b [ 756.913766] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.913861] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.913928] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.914194] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.914281] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.914384] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7927038-4f39-41ce-9b48-a3904071922b already deleted. [ 756.914497] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7927038-4f39-41ce-9b48-a3904071922b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 756.984146] env[70879]: INFO networking_nsxv3.common.synchronization [None req-6458dc47-908d-4090-86f2-d219039b0a6d None None] Enqueued Resource ID: a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3 with Priority: HIGHEST for action port [ 756.985137] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3 with Priority: HIGHEST for action port [ 756.985322] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.985517] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 756.985631] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.986033] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 756.986222] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.490282] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3 [ 757.490556] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.490669] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.490739] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.490961] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.491064] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.491162] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3 already deleted. [ 757.491251] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0ee7cf4-f59d-47e2-9d1a-e8624c3312d3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 757.914833] env[70879]: INFO networking_nsxv3.common.synchronization [None req-b429f623-e9c8-461b-a3e1-779f91fe5195 tempest-VolumesAssistedSnapshotsTest-901381844 tempest-VolumesAssistedSnapshotsTest-901381844-project-member] Enqueued Resource ID: e8447ae9-3f4f-4015-8967-b7e63f9c487a with Priority: HIGHEST for action security_group_rules [ 757.915292] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8447ae9-3f4f-4015-8967-b7e63f9c487a with Priority: HIGHEST for action security_group_rules [ 757.917137] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.917275] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 757.917560] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.917709] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 757.917827] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8447ae9-3f4f-4015-8967-b7e63f9c487a',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.264733] env[70879]: INFO networking_nsxv3.common.synchronization [None req-d9643304-4245-4a43-a2df-34685dec4cc8 tempest-ServersWithSpecificFlavorTestJSON-1596076200 tempest-ServersWithSpecificFlavorTestJSON-1596076200-project-member] Enqueued Resource ID: 0e24d2a8-ce4d-48cb-b14d-28406dfefeed with Priority: HIGHEST for action security_group_rules [ 758.265317] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e24d2a8-ce4d-48cb-b14d-28406dfefeed with Priority: HIGHEST for action security_group_rules [ 758.266556] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.266706] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.266768] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.267056] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.267159] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e24d2a8-ce4d-48cb-b14d-28406dfefeed',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.446551] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.446730] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.446769] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.447122] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.447122] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.447308] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8447ae9-3f4f-4015-8967-b7e63f9c487a already deleted. [ 758.447341] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.526235] env[70879]: INFO networking_nsxv3.common.synchronization [None req-a0b120fb-503d-487a-935a-e0c11f3b627b tempest-VolumesAssistedSnapshotsTest-901381844 tempest-VolumesAssistedSnapshotsTest-901381844-project-member] Enqueued Resource ID: e8447ae9-3f4f-4015-8967-b7e63f9c487a with Priority: HIGHEST for action security_group_rules [ 758.526235] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8447ae9-3f4f-4015-8967-b7e63f9c487a with Priority: HIGHEST for action security_group_rules [ 758.526235] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.526235] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.526235] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.526235] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.529152] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8447ae9-3f4f-4015-8967-b7e63f9c487a',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.796234] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.796413] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.796499] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.796751] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.796840] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.796953] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e24d2a8-ce4d-48cb-b14d-28406dfefeed already deleted. [ 758.797094] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 758.869108] env[70879]: INFO networking_nsxv3.common.synchronization [None req-a5041223-72bb-47bb-87c6-12eead93e9b2 tempest-ServersWithSpecificFlavorTestJSON-1596076200 tempest-ServersWithSpecificFlavorTestJSON-1596076200-project-member] Enqueued Resource ID: 0e24d2a8-ce4d-48cb-b14d-28406dfefeed with Priority: HIGHEST for action security_group_rules [ 758.869952] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e24d2a8-ce4d-48cb-b14d-28406dfefeed with Priority: HIGHEST for action security_group_rules [ 758.870188] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.870311] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 758.870412] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.870595] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 758.870678] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e24d2a8-ce4d-48cb-b14d-28406dfefeed',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.052487] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.052487] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.052487] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.052487] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.052487] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.052487] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8447ae9-3f4f-4015-8967-b7e63f9c487a already deleted. [ 759.052487] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8447ae9-3f4f-4015-8967-b7e63f9c487a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.394389] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.394389] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.394389] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.394389] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.394389] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.394389] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e24d2a8-ce4d-48cb-b14d-28406dfefeed already deleted. [ 759.394389] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e24d2a8-ce4d-48cb-b14d-28406dfefeed" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 759.909966] env[70879]: INFO networking_nsxv3.common.synchronization [None req-91c4cd2f-fc60-4680-81dd-49389a7d566e None None] Enqueued Resource ID: b1a6235b-a177-483d-81eb-f2aa3d0bbb84 with Priority: HIGHEST for action port [ 759.912345] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a6235b-a177-483d-81eb-f2aa3d0bbb84 with Priority: HIGHEST for action port [ 759.912345] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a6235b-a177-483d-81eb-f2aa3d0bbb84 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.912345] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a6235b-a177-483d-81eb-f2aa3d0bbb84" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 759.912345] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a6235b-a177-483d-81eb-f2aa3d0bbb84" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.916720] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a6235b-a177-483d-81eb-f2aa3d0bbb84" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 759.916720] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a6235b-a177-483d-81eb-f2aa3d0bbb84',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.430266] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1a6235b-a177-483d-81eb-f2aa3d0bbb84 [ 760.430266] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.430266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 760.430266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.430266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 760.430266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 760.430266] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1a6235b-a177-483d-81eb-f2aa3d0bbb84 already deleted. [ 760.430266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a6235b-a177-483d-81eb-f2aa3d0bbb84" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 764.911698] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 764.911936] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 766.098258] env[70879]: INFO networking_nsxv3.common.synchronization [None req-7a7b2e6d-f732-4bf0-9115-78ed561229f6 None None] Enqueued Resource ID: f23ac9b5-7bc4-4247-9cef-291fd560527b with Priority: HIGHEST for action port [ 766.099514] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f23ac9b5-7bc4-4247-9cef-291fd560527b with Priority: HIGHEST for action port [ 766.099514] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-f23ac9b5-7bc4-4247-9cef-291fd560527b taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.099694] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f23ac9b5-7bc4-4247-9cef-291fd560527b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.099744] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f23ac9b5-7bc4-4247-9cef-291fd560527b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.101747] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f23ac9b5-7bc4-4247-9cef-291fd560527b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.101863] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f23ac9b5-7bc4-4247-9cef-291fd560527b',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.357102] env[70879]: INFO networking_nsxv3.common.synchronization [None req-a752d05d-a18e-48fb-9b4c-537a4a184c0c None None] Enqueued Resource ID: 70470455-ffc8-48cd-b946-bb6b45ba5f34 with Priority: HIGHEST for action port [ 766.357946] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70470455-ffc8-48cd-b946-bb6b45ba5f34 with Priority: HIGHEST for action port [ 766.357998] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-70470455-ffc8-48cd-b946-bb6b45ba5f34 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.358152] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70470455-ffc8-48cd-b946-bb6b45ba5f34" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.358200] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70470455-ffc8-48cd-b946-bb6b45ba5f34" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.358464] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70470455-ffc8-48cd-b946-bb6b45ba5f34" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.358540] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70470455-ffc8-48cd-b946-bb6b45ba5f34',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.608819] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f23ac9b5-7bc4-4247-9cef-291fd560527b [ 766.608819] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.609175] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.609175] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.609386] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.610038] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.610038] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f23ac9b5-7bc4-4247-9cef-291fd560527b already deleted. [ 766.610038] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f23ac9b5-7bc4-4247-9cef-291fd560527b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.861962] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70470455-ffc8-48cd-b946-bb6b45ba5f34 [ 766.861962] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.861962] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 766.862117] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.862259] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 766.862447] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 766.862447] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70470455-ffc8-48cd-b946-bb6b45ba5f34 already deleted. [ 766.862534] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70470455-ffc8-48cd-b946-bb6b45ba5f34" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.364189] env[70879]: INFO networking_nsxv3.common.synchronization [None req-172c7f6f-7c51-4fe7-acf5-4517394e550e None None] Enqueued Resource ID: 35a511f0-3c7c-43f4-b343-9aecec82e071 with Priority: HIGHEST for action port [ 768.364795] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35a511f0-3c7c-43f4-b343-9aecec82e071 with Priority: HIGHEST for action port [ 768.365297] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-35a511f0-3c7c-43f4-b343-9aecec82e071 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.365453] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35a511f0-3c7c-43f4-b343-9aecec82e071" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.368594] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35a511f0-3c7c-43f4-b343-9aecec82e071" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.368594] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35a511f0-3c7c-43f4-b343-9aecec82e071" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.368594] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35a511f0-3c7c-43f4-b343-9aecec82e071',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.625371] env[70879]: INFO networking_nsxv3.common.synchronization [None req-3e686c0d-8e05-473d-92be-8c7402d949a9 None None] Enqueued Resource ID: b7e42856-75b7-47ea-9b59-2a8752a0a4d7 with Priority: HIGHEST for action port [ 768.625371] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7e42856-75b7-47ea-9b59-2a8752a0a4d7 with Priority: HIGHEST for action port [ 768.625371] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7e42856-75b7-47ea-9b59-2a8752a0a4d7 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.625371] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7e42856-75b7-47ea-9b59-2a8752a0a4d7" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.625371] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7e42856-75b7-47ea-9b59-2a8752a0a4d7" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.625371] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7e42856-75b7-47ea-9b59-2a8752a0a4d7" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.625371] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7e42856-75b7-47ea-9b59-2a8752a0a4d7',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.875432] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35a511f0-3c7c-43f4-b343-9aecec82e071 [ 768.875432] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.875432] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 768.875432] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.875432] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 768.875432] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 768.875432] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35a511f0-3c7c-43f4-b343-9aecec82e071 already deleted. [ 768.875432] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35a511f0-3c7c-43f4-b343-9aecec82e071" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.131830] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7e42856-75b7-47ea-9b59-2a8752a0a4d7 [ 769.131830] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.131830] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 769.131830] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.131830] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 769.131830] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 769.131830] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7e42856-75b7-47ea-9b59-2a8752a0a4d7 already deleted. [ 769.131830] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7e42856-75b7-47ea-9b59-2a8752a0a4d7" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.323288] env[70879]: INFO networking_nsxv3.common.synchronization [None req-2aa21857-1ee7-4fd0-a83c-85dd031b6f81 None None] Enqueued Resource ID: 95325e95-9ab0-4a49-a25b-cf2e4acd5e63 with Priority: HIGHEST for action port [ 770.323539] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95325e95-9ab0-4a49-a25b-cf2e4acd5e63 with Priority: HIGHEST for action port [ 770.324177] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-95325e95-9ab0-4a49-a25b-cf2e4acd5e63 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.324619] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95325e95-9ab0-4a49-a25b-cf2e4acd5e63" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.326633] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95325e95-9ab0-4a49-a25b-cf2e4acd5e63" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.326926] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95325e95-9ab0-4a49-a25b-cf2e4acd5e63" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.326993] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95325e95-9ab0-4a49-a25b-cf2e4acd5e63',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.829986] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95325e95-9ab0-4a49-a25b-cf2e4acd5e63 [ 770.830237] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.830377] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 770.830450] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.830667] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 770.830759] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 770.830855] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95325e95-9ab0-4a49-a25b-cf2e4acd5e63 already deleted. [ 770.830937] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95325e95-9ab0-4a49-a25b-cf2e4acd5e63" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 771.624882] env[70879]: INFO networking_nsxv3.common.synchronization [None req-518932b8-4ff2-4314-b676-d3467cb09000 None None] Enqueued Resource ID: 55cca6b5-da7d-4c76-b5b7-d37b18e1374e with Priority: HIGHEST for action port [ 771.625149] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55cca6b5-da7d-4c76-b5b7-d37b18e1374e with Priority: HIGHEST for action port [ 771.626465] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-55cca6b5-da7d-4c76-b5b7-d37b18e1374e taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.626465] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55cca6b5-da7d-4c76-b5b7-d37b18e1374e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 771.626465] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55cca6b5-da7d-4c76-b5b7-d37b18e1374e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.626465] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55cca6b5-da7d-4c76-b5b7-d37b18e1374e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 771.626465] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55cca6b5-da7d-4c76-b5b7-d37b18e1374e',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.128146] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55cca6b5-da7d-4c76-b5b7-d37b18e1374e [ 772.128380] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.128528] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 772.128601] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.128790] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 772.128875] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 772.128966] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55cca6b5-da7d-4c76-b5b7-d37b18e1374e already deleted. [ 772.129059] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55cca6b5-da7d-4c76-b5b7-d37b18e1374e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 773.963655] env[70879]: INFO networking_nsxv3.common.synchronization [None req-566bb9fd-018f-4e5d-91c6-bac78b39575f None None] Enqueued Resource ID: b0a1f505-f1ec-4fa4-a66d-aea8199ccf36 with Priority: HIGHEST for action port [ 773.964183] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a1f505-f1ec-4fa4-a66d-aea8199ccf36 with Priority: HIGHEST for action port [ 773.964591] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0a1f505-f1ec-4fa4-a66d-aea8199ccf36 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.964591] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0a1f505-f1ec-4fa4-a66d-aea8199ccf36" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 773.964741] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0a1f505-f1ec-4fa4-a66d-aea8199ccf36" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.965071] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0a1f505-f1ec-4fa4-a66d-aea8199ccf36" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 773.965071] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0a1f505-f1ec-4fa4-a66d-aea8199ccf36',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.469431] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0a1f505-f1ec-4fa4-a66d-aea8199ccf36 [ 774.470061] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.470210] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 774.470279] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.470504] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 774.470786] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 774.470786] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0a1f505-f1ec-4fa4-a66d-aea8199ccf36 already deleted. [ 774.472177] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0a1f505-f1ec-4fa4-a66d-aea8199ccf36" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.089283] env[70879]: INFO networking_nsxv3.common.synchronization [None req-82510634-7bdd-46b9-8c73-4f80dd357dc5 None None] Enqueued Resource ID: 8f6f6ca3-8367-4439-8c3e-1d87a22af150 with Priority: HIGHEST for action port [ 775.089544] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f6f6ca3-8367-4439-8c3e-1d87a22af150 with Priority: HIGHEST for action port [ 775.089902] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f6f6ca3-8367-4439-8c3e-1d87a22af150 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.090033] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f6f6ca3-8367-4439-8c3e-1d87a22af150" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.090033] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f6f6ca3-8367-4439-8c3e-1d87a22af150" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.090399] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f6f6ca3-8367-4439-8c3e-1d87a22af150" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.090399] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f6f6ca3-8367-4439-8c3e-1d87a22af150',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.597034] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f6f6ca3-8367-4439-8c3e-1d87a22af150 [ 775.597034] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.597034] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 775.597034] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.597278] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 775.597428] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 775.597536] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f6f6ca3-8367-4439-8c3e-1d87a22af150 already deleted. [ 775.597620] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f6f6ca3-8367-4439-8c3e-1d87a22af150" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.391895] env[70879]: INFO networking_nsxv3.common.synchronization [None req-de59daed-dc83-495b-994e-5b2075f2f8b8 None None] Enqueued Resource ID: 50f2f160-fd9c-4974-94d7-494bbe4e2304 with Priority: HIGHEST for action port [ 776.391895] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f2f160-fd9c-4974-94d7-494bbe4e2304 with Priority: HIGHEST for action port [ 776.392335] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f2f160-fd9c-4974-94d7-494bbe4e2304 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.396930] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f2f160-fd9c-4974-94d7-494bbe4e2304" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.396930] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f2f160-fd9c-4974-94d7-494bbe4e2304" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.396930] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f2f160-fd9c-4974-94d7-494bbe4e2304" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.396930] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f2f160-fd9c-4974-94d7-494bbe4e2304',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.798236] env[70879]: INFO networking_nsxv3.common.synchronization [None req-3da24229-3105-4115-a6ff-1c9b431f4b76 None None] Enqueued Resource ID: 08871a23-5b55-4ba4-ae88-4f110c3ddbad with Priority: HIGHEST for action port [ 776.799522] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08871a23-5b55-4ba4-ae88-4f110c3ddbad with Priority: HIGHEST for action port [ 776.800292] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-08871a23-5b55-4ba4-ae88-4f110c3ddbad taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.800483] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08871a23-5b55-4ba4-ae88-4f110c3ddbad" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.800554] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08871a23-5b55-4ba4-ae88-4f110c3ddbad" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.802012] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08871a23-5b55-4ba4-ae88-4f110c3ddbad" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.802012] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08871a23-5b55-4ba4-ae88-4f110c3ddbad',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.905451] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50f2f160-fd9c-4974-94d7-494bbe4e2304 [ 776.906526] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.906526] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 776.906526] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.908415] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 776.908415] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 776.908415] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50f2f160-fd9c-4974-94d7-494bbe4e2304 already deleted. [ 776.908415] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f2f160-fd9c-4974-94d7-494bbe4e2304" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.303242] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08871a23-5b55-4ba4-ae88-4f110c3ddbad [ 777.303590] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.303742] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.304029] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.304784] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.304886] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.304993] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08871a23-5b55-4ba4-ae88-4f110c3ddbad already deleted. [ 777.305090] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08871a23-5b55-4ba4-ae88-4f110c3ddbad" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 777.839194] env[70879]: INFO networking_nsxv3.common.synchronization [None req-5b3d9431-c725-4c8d-a558-31ec567ac83d None None] Enqueued Resource ID: f1b4b32f-1bdc-4b81-8ac2-92bcace76507 with Priority: HIGHEST for action port [ 777.839194] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b4b32f-1bdc-4b81-8ac2-92bcace76507 with Priority: HIGHEST for action port [ 777.839194] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1b4b32f-1bdc-4b81-8ac2-92bcace76507 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.839194] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1b4b32f-1bdc-4b81-8ac2-92bcace76507" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 777.839194] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1b4b32f-1bdc-4b81-8ac2-92bcace76507" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.839194] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1b4b32f-1bdc-4b81-8ac2-92bcace76507" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 777.840290] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b4b32f-1bdc-4b81-8ac2-92bcace76507',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.344093] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1b4b32f-1bdc-4b81-8ac2-92bcace76507 [ 778.344093] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.344093] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 778.344093] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.344093] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 778.344093] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 778.344093] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1b4b32f-1bdc-4b81-8ac2-92bcace76507 already deleted. [ 778.344093] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1b4b32f-1bdc-4b81-8ac2-92bcace76507" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 780.660095] env[70879]: INFO networking_nsxv3.common.synchronization [None req-30f9b06d-aa25-492b-903d-5c50d72208bf None None] Enqueued Resource ID: 1f365832-973b-4124-975e-ffa8aafd2bc2 with Priority: HIGHEST for action port [ 780.660095] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f365832-973b-4124-975e-ffa8aafd2bc2 with Priority: HIGHEST for action port [ 780.660095] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f365832-973b-4124-975e-ffa8aafd2bc2 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.660095] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f365832-973b-4124-975e-ffa8aafd2bc2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.660095] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f365832-973b-4124-975e-ffa8aafd2bc2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.660938] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f365832-973b-4124-975e-ffa8aafd2bc2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.660938] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f365832-973b-4124-975e-ffa8aafd2bc2',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.911946] env[70879]: INFO networking_nsxv3.common.synchronization [req-a40c5170-2fe8-4060-8b4e-6ec4e1653b02 req-e6eb4934-2f91-426f-b4cc-a909cc7f57e3 tempest-SecurityGroupRulesTestJSON-687639067 tempest-SecurityGroupRulesTestJSON-687639067-project-member] Enqueued Resource ID: 3afe9d13-93dc-40e1-9fb2-3cb4a349ba03 with Priority: HIGHEST for action security_group_rules [ 780.913501] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3afe9d13-93dc-40e1-9fb2-3cb4a349ba03 with Priority: HIGHEST for action security_group_rules [ 780.913717] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3afe9d13-93dc-40e1-9fb2-3cb4a349ba03 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.913821] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3afe9d13-93dc-40e1-9fb2-3cb4a349ba03" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 780.913886] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3afe9d13-93dc-40e1-9fb2-3cb4a349ba03" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.915987] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3afe9d13-93dc-40e1-9fb2-3cb4a349ba03" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 780.916092] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3afe9d13-93dc-40e1-9fb2-3cb4a349ba03',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.171372] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f365832-973b-4124-975e-ffa8aafd2bc2 [ 781.171372] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.171372] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.171372] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.171372] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.171372] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.171372] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f365832-973b-4124-975e-ffa8aafd2bc2 already deleted. [ 781.171372] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f365832-973b-4124-975e-ffa8aafd2bc2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.270969] env[70879]: INFO networking_nsxv3.common.synchronization [None req-5a5d2220-b12c-47c3-a8ba-f36b4f1242b0 None None] Enqueued Resource ID: ddde0e70-ae5a-4176-ae6b-26fe7d76deb9 with Priority: HIGHEST for action port [ 781.271231] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddde0e70-ae5a-4176-ae6b-26fe7d76deb9 with Priority: HIGHEST for action port [ 781.271776] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddde0e70-ae5a-4176-ae6b-26fe7d76deb9 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.271909] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddde0e70-ae5a-4176-ae6b-26fe7d76deb9" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.271971] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddde0e70-ae5a-4176-ae6b-26fe7d76deb9" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.272358] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddde0e70-ae5a-4176-ae6b-26fe7d76deb9" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.272358] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddde0e70-ae5a-4176-ae6b-26fe7d76deb9',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.442231] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.442362] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.442432] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.442651] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.442734] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.443621] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3afe9d13-93dc-40e1-9fb2-3cb4a349ba03 already deleted. [ 781.443823] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3afe9d13-93dc-40e1-9fb2-3cb4a349ba03" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.722516] env[70879]: INFO networking_nsxv3.common.synchronization [None req-93cba2be-3520-4383-be5f-58d4065d64e3 None None] Enqueued Resource ID: 693795c2-d826-432d-922c-11f8cce9af6d with Priority: HIGHEST for action port [ 781.722516] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 693795c2-d826-432d-922c-11f8cce9af6d with Priority: HIGHEST for action port [ 781.722516] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-693795c2-d826-432d-922c-11f8cce9af6d taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.722516] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-693795c2-d826-432d-922c-11f8cce9af6d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.722516] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-693795c2-d826-432d-922c-11f8cce9af6d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.724133] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-693795c2-d826-432d-922c-11f8cce9af6d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.724133] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('693795c2-d826-432d-922c-11f8cce9af6d',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.776020] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddde0e70-ae5a-4176-ae6b-26fe7d76deb9 [ 781.776020] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.776020] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.776020] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.776274] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.776274] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.776363] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddde0e70-ae5a-4176-ae6b-26fe7d76deb9 already deleted. [ 781.776441] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddde0e70-ae5a-4176-ae6b-26fe7d76deb9" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 781.855138] env[70879]: INFO networking_nsxv3.common.synchronization [None req-98ec3363-d9e5-4e43-b238-9d6f17d70085 None None] Enqueued Resource ID: a5409a04-394a-42c1-9c4a-01916bb2af59 with Priority: HIGHEST for action port [ 781.855138] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5409a04-394a-42c1-9c4a-01916bb2af59 with Priority: HIGHEST for action port [ 781.855138] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5409a04-394a-42c1-9c4a-01916bb2af59 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.855865] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5409a04-394a-42c1-9c4a-01916bb2af59" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 781.856074] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5409a04-394a-42c1-9c4a-01916bb2af59" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.856405] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5409a04-394a-42c1-9c4a-01916bb2af59" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 781.856595] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5409a04-394a-42c1-9c4a-01916bb2af59',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.228716] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 693795c2-d826-432d-922c-11f8cce9af6d [ 782.228945] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.229092] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.229158] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.229377] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.229465] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.229544] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:693795c2-d826-432d-922c-11f8cce9af6d already deleted. [ 782.229619] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-693795c2-d826-432d-922c-11f8cce9af6d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.358926] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5409a04-394a-42c1-9c4a-01916bb2af59 [ 782.359922] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.359922] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.359922] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.359922] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.359922] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.360208] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5409a04-394a-42c1-9c4a-01916bb2af59 already deleted. [ 782.360208] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5409a04-394a-42c1-9c4a-01916bb2af59" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.467231] env[70879]: INFO networking_nsxv3.common.synchronization [None req-447f8120-d7ea-4f10-82a4-52abc30b70d8 None None] Enqueued Resource ID: c38845df-9304-45f0-bb7d-d896ef24f25d with Priority: HIGHEST for action port [ 782.467487] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38845df-9304-45f0-bb7d-d896ef24f25d with Priority: HIGHEST for action port [ 782.468059] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-c38845df-9304-45f0-bb7d-d896ef24f25d taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.468179] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c38845df-9304-45f0-bb7d-d896ef24f25d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.468389] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c38845df-9304-45f0-bb7d-d896ef24f25d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.468488] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c38845df-9304-45f0-bb7d-d896ef24f25d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.468565] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c38845df-9304-45f0-bb7d-d896ef24f25d',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.887884] env[70879]: INFO networking_nsxv3.common.synchronization [None req-e46cacdf-6115-4791-ae3d-70b2ab86c745 None None] Enqueued Resource ID: 4c809adc-c747-400c-a6ff-70d2d9221f7b with Priority: HIGHEST for action port [ 782.889471] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c809adc-c747-400c-a6ff-70d2d9221f7b with Priority: HIGHEST for action port [ 782.889907] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c809adc-c747-400c-a6ff-70d2d9221f7b taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.890086] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c809adc-c747-400c-a6ff-70d2d9221f7b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.890180] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c809adc-c747-400c-a6ff-70d2d9221f7b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.890821] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c809adc-c747-400c-a6ff-70d2d9221f7b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.890821] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c809adc-c747-400c-a6ff-70d2d9221f7b',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.975632] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c38845df-9304-45f0-bb7d-d896ef24f25d [ 782.975976] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.976223] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 782.976322] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.976572] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 782.976797] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 782.976942] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c38845df-9304-45f0-bb7d-d896ef24f25d already deleted. [ 782.977091] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c38845df-9304-45f0-bb7d-d896ef24f25d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.393398] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c809adc-c747-400c-a6ff-70d2d9221f7b [ 783.393643] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.393815] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 783.393885] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.394113] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 783.394203] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 783.394302] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c809adc-c747-400c-a6ff-70d2d9221f7b already deleted. [ 783.394487] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c809adc-c747-400c-a6ff-70d2d9221f7b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.165521] env[70879]: INFO networking_nsxv3.common.synchronization [None req-3e723170-1978-4993-bf57-73d0dc35f275 None None] Enqueued Resource ID: 21657508-5fdb-4ab5-bb36-beb39e4b766d with Priority: HIGHEST for action port [ 785.166373] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21657508-5fdb-4ab5-bb36-beb39e4b766d with Priority: HIGHEST for action port [ 785.166863] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-21657508-5fdb-4ab5-bb36-beb39e4b766d taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.166972] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21657508-5fdb-4ab5-bb36-beb39e4b766d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.167400] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21657508-5fdb-4ab5-bb36-beb39e4b766d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.167400] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21657508-5fdb-4ab5-bb36-beb39e4b766d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.167511] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21657508-5fdb-4ab5-bb36-beb39e4b766d',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.193477] env[70879]: INFO networking_nsxv3.common.synchronization [None req-03e5874d-16cf-4067-a98c-e9dea4dfd5fb None None] Enqueued Resource ID: 4035964e-94b4-4fb8-92ba-7106f9dff187 with Priority: HIGHEST for action port [ 785.193477] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4035964e-94b4-4fb8-92ba-7106f9dff187 with Priority: HIGHEST for action port [ 785.193477] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-4035964e-94b4-4fb8-92ba-7106f9dff187 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.193477] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4035964e-94b4-4fb8-92ba-7106f9dff187" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.193477] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4035964e-94b4-4fb8-92ba-7106f9dff187" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.193477] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4035964e-94b4-4fb8-92ba-7106f9dff187" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.193477] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4035964e-94b4-4fb8-92ba-7106f9dff187',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.671886] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21657508-5fdb-4ab5-bb36-beb39e4b766d [ 785.671886] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.671886] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.671886] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.671886] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.671886] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.671886] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21657508-5fdb-4ab5-bb36-beb39e4b766d already deleted. [ 785.671886] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21657508-5fdb-4ab5-bb36-beb39e4b766d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.696675] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4035964e-94b4-4fb8-92ba-7106f9dff187 [ 785.696675] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.696807] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 785.696853] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.699936] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 785.699936] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 785.699936] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4035964e-94b4-4fb8-92ba-7106f9dff187 already deleted. [ 785.699936] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4035964e-94b4-4fb8-92ba-7106f9dff187" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.167278] env[70879]: INFO networking_nsxv3.common.synchronization [None req-33d37eec-9d7a-402e-bb46-eafb96a1ae95 None None] Enqueued Resource ID: be68db4e-89b7-42b8-93f9-c02c59af2c19 with Priority: HIGHEST for action port [ 786.168251] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be68db4e-89b7-42b8-93f9-c02c59af2c19 with Priority: HIGHEST for action port [ 786.170198] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-be68db4e-89b7-42b8-93f9-c02c59af2c19 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.170270] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be68db4e-89b7-42b8-93f9-c02c59af2c19" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.170303] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be68db4e-89b7-42b8-93f9-c02c59af2c19" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.170840] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be68db4e-89b7-42b8-93f9-c02c59af2c19" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.171705] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be68db4e-89b7-42b8-93f9-c02c59af2c19',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.643226] env[70879]: INFO networking_nsxv3.common.synchronization [None req-049532c4-3653-4980-a878-a2d76a6ebd75 None None] Enqueued Resource ID: 3ef01882-b8cb-4a75-ae4d-7e821b554edd with Priority: HIGHEST for action port [ 786.643226] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ef01882-b8cb-4a75-ae4d-7e821b554edd with Priority: HIGHEST for action port [ 786.644969] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ef01882-b8cb-4a75-ae4d-7e821b554edd taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.644969] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ef01882-b8cb-4a75-ae4d-7e821b554edd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.644969] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ef01882-b8cb-4a75-ae4d-7e821b554edd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.644969] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ef01882-b8cb-4a75-ae4d-7e821b554edd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.645324] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ef01882-b8cb-4a75-ae4d-7e821b554edd',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.673675] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be68db4e-89b7-42b8-93f9-c02c59af2c19 [ 786.673909] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.674990] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 786.675109] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.675403] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 786.675510] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 786.675614] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be68db4e-89b7-42b8-93f9-c02c59af2c19 already deleted. [ 786.675694] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be68db4e-89b7-42b8-93f9-c02c59af2c19" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.147691] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ef01882-b8cb-4a75-ae4d-7e821b554edd [ 787.147932] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.148088] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.148152] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.148411] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.148498] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.148704] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ef01882-b8cb-4a75-ae4d-7e821b554edd already deleted. [ 787.148704] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ef01882-b8cb-4a75-ae4d-7e821b554edd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.357284] env[70879]: INFO networking_nsxv3.common.synchronization [None req-90abb677-90f7-490a-81b6-d06e1df36997 None None] Enqueued Resource ID: 3c1ef141-3770-4596-bf45-e67efa05b3ff with Priority: HIGHEST for action port [ 787.358175] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c1ef141-3770-4596-bf45-e67efa05b3ff with Priority: HIGHEST for action port [ 787.358473] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c1ef141-3770-4596-bf45-e67efa05b3ff taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.359414] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c1ef141-3770-4596-bf45-e67efa05b3ff" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.359414] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c1ef141-3770-4596-bf45-e67efa05b3ff" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.359414] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c1ef141-3770-4596-bf45-e67efa05b3ff" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.359611] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c1ef141-3770-4596-bf45-e67efa05b3ff',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.862968] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c1ef141-3770-4596-bf45-e67efa05b3ff [ 787.862968] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.862968] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 787.862968] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.862968] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 787.862968] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 787.862968] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c1ef141-3770-4596-bf45-e67efa05b3ff already deleted. [ 787.862968] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c1ef141-3770-4596-bf45-e67efa05b3ff" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.197884] env[70879]: INFO networking_nsxv3.common.synchronization [None req-5eef5668-f719-42d2-a572-f64b2cca53fa None None] Enqueued Resource ID: 8304f8c8-d0a6-4565-9e24-d328e3eeed8f with Priority: HIGHEST for action port [ 788.198124] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8304f8c8-d0a6-4565-9e24-d328e3eeed8f with Priority: HIGHEST for action port [ 788.198724] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-8304f8c8-d0a6-4565-9e24-d328e3eeed8f taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.198871] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8304f8c8-d0a6-4565-9e24-d328e3eeed8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.198941] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8304f8c8-d0a6-4565-9e24-d328e3eeed8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.200181] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8304f8c8-d0a6-4565-9e24-d328e3eeed8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.200181] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8304f8c8-d0a6-4565-9e24-d328e3eeed8f',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.397535] env[70879]: INFO networking_nsxv3.common.synchronization [None req-9e33ed1f-8cf5-435c-a3c5-cd0b8409ed1f None None] Enqueued Resource ID: cf5fe241-284f-4a52-8e6c-592f7b549082 with Priority: HIGHEST for action port [ 788.399124] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5fe241-284f-4a52-8e6c-592f7b549082 with Priority: HIGHEST for action port [ 788.399951] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf5fe241-284f-4a52-8e6c-592f7b549082 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.399951] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf5fe241-284f-4a52-8e6c-592f7b549082" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.399951] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf5fe241-284f-4a52-8e6c-592f7b549082" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.399951] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf5fe241-284f-4a52-8e6c-592f7b549082" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.399951] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf5fe241-284f-4a52-8e6c-592f7b549082',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.702506] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8304f8c8-d0a6-4565-9e24-d328e3eeed8f [ 788.702929] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.706377] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.706377] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.706377] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.706377] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.706377] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8304f8c8-d0a6-4565-9e24-d328e3eeed8f already deleted. [ 788.706377] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8304f8c8-d0a6-4565-9e24-d328e3eeed8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.902337] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf5fe241-284f-4a52-8e6c-592f7b549082 [ 788.902508] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.902992] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 788.902992] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.902992] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 788.902992] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 788.903151] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf5fe241-284f-4a52-8e6c-592f7b549082 already deleted. [ 788.903151] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf5fe241-284f-4a52-8e6c-592f7b549082" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.141529] env[70879]: INFO networking_nsxv3.common.synchronization [req-dbbe8ba9-6b77-4505-aeb4-8bb15fdce024 req-00e2c516-b2c9-4bd0-89f1-13f94b6fd9a9 tempest-SecurityGroupRulesTestJSON-687639067 tempest-SecurityGroupRulesTestJSON-687639067-project-member] Enqueued Resource ID: 83f5f0bc-42d8-4ca5-94d4-b0d906b08f1f with Priority: HIGHEST for action security_group_rules [ 790.142066] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83f5f0bc-42d8-4ca5-94d4-b0d906b08f1f with Priority: HIGHEST for action security_group_rules [ 790.142360] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83f5f0bc-42d8-4ca5-94d4-b0d906b08f1f taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.142482] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83f5f0bc-42d8-4ca5-94d4-b0d906b08f1f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.142545] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83f5f0bc-42d8-4ca5-94d4-b0d906b08f1f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.142798] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83f5f0bc-42d8-4ca5-94d4-b0d906b08f1f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.142882] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83f5f0bc-42d8-4ca5-94d4-b0d906b08f1f',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.324918] env[70879]: INFO networking_nsxv3.common.synchronization [None req-26fc8d6a-dfd9-4c3b-8de4-127c4ed1396f tempest-ServersTestManualDisk-55734170 tempest-ServersTestManualDisk-55734170-project-member] Enqueued Resource ID: cfeefd4a-0165-4740-84a6-d83466a5789e with Priority: HIGHEST for action security_group_rules [ 790.326492] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfeefd4a-0165-4740-84a6-d83466a5789e with Priority: HIGHEST for action security_group_rules [ 790.326492] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfeefd4a-0165-4740-84a6-d83466a5789e taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.326654] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfeefd4a-0165-4740-84a6-d83466a5789e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.326739] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfeefd4a-0165-4740-84a6-d83466a5789e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.327493] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfeefd4a-0165-4740-84a6-d83466a5789e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.327493] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfeefd4a-0165-4740-84a6-d83466a5789e',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.545320] env[70879]: INFO networking_nsxv3.common.synchronization [None req-2fbdfe24-333c-468d-a1cc-231ff0aa44e0 tempest-ServersTestManualDisk-55734170 tempest-ServersTestManualDisk-55734170-project-member] Enqueued Resource ID: cfeefd4a-0165-4740-84a6-d83466a5789e with Priority: HIGHEST for action security_group_rules [ 790.545320] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfeefd4a-0165-4740-84a6-d83466a5789e with Priority: HIGHEST for action security_group_rules [ 790.545320] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfeefd4a-0165-4740-84a6-d83466a5789e taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.545320] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfeefd4a-0165-4740-84a6-d83466a5789e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.667427] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.667623] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.667943] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.667943] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.668111] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.668165] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83f5f0bc-42d8-4ca5-94d4-b0d906b08f1f already deleted. [ 790.668227] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83f5f0bc-42d8-4ca5-94d4-b0d906b08f1f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.849757] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.850204] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 790.850318] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.852099] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.852243] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.852693] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfeefd4a-0165-4740-84a6-d83466a5789e already deleted. [ 790.852832] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfeefd4a-0165-4740-84a6-d83466a5789e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 790.853665] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfeefd4a-0165-4740-84a6-d83466a5789e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.853877] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfeefd4a-0165-4740-84a6-d83466a5789e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 790.853973] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfeefd4a-0165-4740-84a6-d83466a5789e',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.086197] env[70879]: INFO networking_nsxv3.common.synchronization [None req-23c962d0-22ff-4be1-8fe7-9422fe2fe29c None None] Enqueued Resource ID: f34689ae-a67d-4f1b-891a-999e82446cd3 with Priority: HIGHEST for action port [ 791.086197] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f34689ae-a67d-4f1b-891a-999e82446cd3 with Priority: HIGHEST for action port [ 791.086197] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-f34689ae-a67d-4f1b-891a-999e82446cd3 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.086197] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f34689ae-a67d-4f1b-891a-999e82446cd3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.086197] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f34689ae-a67d-4f1b-891a-999e82446cd3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.086197] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f34689ae-a67d-4f1b-891a-999e82446cd3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.086197] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f34689ae-a67d-4f1b-891a-999e82446cd3',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.380364] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.380364] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.380713] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.380713] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.380780] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.380813] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfeefd4a-0165-4740-84a6-d83466a5789e already deleted. [ 791.380889] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfeefd4a-0165-4740-84a6-d83466a5789e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.588192] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f34689ae-a67d-4f1b-891a-999e82446cd3 [ 791.588463] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.588570] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.588621] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.588824] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.588943] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.589054] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f34689ae-a67d-4f1b-891a-999e82446cd3 already deleted. [ 791.589120] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f34689ae-a67d-4f1b-891a-999e82446cd3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 791.634372] env[70879]: INFO networking_nsxv3.common.synchronization [None req-a77b9fdc-03a2-49a8-aac6-9178c02281e2 None None] Enqueued Resource ID: 7c226c0b-687f-4b15-bd54-2bbc9d5c4d96 with Priority: HIGHEST for action port [ 791.635579] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c226c0b-687f-4b15-bd54-2bbc9d5c4d96 with Priority: HIGHEST for action port [ 791.636128] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c226c0b-687f-4b15-bd54-2bbc9d5c4d96 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.636251] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c226c0b-687f-4b15-bd54-2bbc9d5c4d96" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 791.636309] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c226c0b-687f-4b15-bd54-2bbc9d5c4d96" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.636735] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c226c0b-687f-4b15-bd54-2bbc9d5c4d96" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 791.636735] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c226c0b-687f-4b15-bd54-2bbc9d5c4d96',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.043547] env[70879]: INFO networking_nsxv3.common.synchronization [None req-6dd51d76-ba43-4212-bc20-2847c12f3809 None None] Enqueued Resource ID: a68c86dc-cc3c-4a16-a8b2-27b469e13129 with Priority: HIGHEST for action port [ 792.043786] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a68c86dc-cc3c-4a16-a8b2-27b469e13129 with Priority: HIGHEST for action port [ 792.044708] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-a68c86dc-cc3c-4a16-a8b2-27b469e13129 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.044708] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a68c86dc-cc3c-4a16-a8b2-27b469e13129" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 792.044708] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a68c86dc-cc3c-4a16-a8b2-27b469e13129" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.044911] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a68c86dc-cc3c-4a16-a8b2-27b469e13129" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 792.044911] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a68c86dc-cc3c-4a16-a8b2-27b469e13129',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.139122] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c226c0b-687f-4b15-bd54-2bbc9d5c4d96 [ 792.139635] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.139807] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 792.139897] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.140254] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 792.140362] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.140514] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c226c0b-687f-4b15-bd54-2bbc9d5c4d96 already deleted. [ 792.140649] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c226c0b-687f-4b15-bd54-2bbc9d5c4d96" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.551721] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a68c86dc-cc3c-4a16-a8b2-27b469e13129 [ 792.551721] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.551721] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 792.551721] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.551721] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 792.551721] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 792.551721] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a68c86dc-cc3c-4a16-a8b2-27b469e13129 already deleted. [ 792.551721] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a68c86dc-cc3c-4a16-a8b2-27b469e13129" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.098185] env[70879]: INFO networking_nsxv3.common.synchronization [None req-ad709649-ad9a-4c90-ab10-a10a5ac494e9 None None] Enqueued Resource ID: 4bb5bebc-2850-40fd-b78b-6fccfe3cef11 with Priority: HIGHEST for action port [ 793.098185] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb5bebc-2850-40fd-b78b-6fccfe3cef11 with Priority: HIGHEST for action port [ 793.098185] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bb5bebc-2850-40fd-b78b-6fccfe3cef11 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.098185] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bb5bebc-2850-40fd-b78b-6fccfe3cef11" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.098185] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bb5bebc-2850-40fd-b78b-6fccfe3cef11" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.098185] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bb5bebc-2850-40fd-b78b-6fccfe3cef11" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.098185] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bb5bebc-2850-40fd-b78b-6fccfe3cef11',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.600156] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bb5bebc-2850-40fd-b78b-6fccfe3cef11 [ 793.600453] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.600526] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.600595] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.600813] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.600901] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.600996] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bb5bebc-2850-40fd-b78b-6fccfe3cef11 already deleted. [ 793.601091] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bb5bebc-2850-40fd-b78b-6fccfe3cef11" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 793.855151] env[70879]: INFO networking_nsxv3.common.synchronization [None req-12e983e6-1895-4636-a251-06338066a56b None None] Enqueued Resource ID: aaca6037-24f9-445b-99ad-dad1e6c4cf89 with Priority: HIGHEST for action port [ 793.855430] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaca6037-24f9-445b-99ad-dad1e6c4cf89 with Priority: HIGHEST for action port [ 793.856091] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaca6037-24f9-445b-99ad-dad1e6c4cf89 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.856224] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaca6037-24f9-445b-99ad-dad1e6c4cf89" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 793.856432] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaca6037-24f9-445b-99ad-dad1e6c4cf89" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.856787] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaca6037-24f9-445b-99ad-dad1e6c4cf89" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 793.856892] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaca6037-24f9-445b-99ad-dad1e6c4cf89',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.358517] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaca6037-24f9-445b-99ad-dad1e6c4cf89 [ 794.358958] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.358958] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 794.358958] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.359330] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 794.359330] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 794.359484] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaca6037-24f9-445b-99ad-dad1e6c4cf89 already deleted. [ 794.359484] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaca6037-24f9-445b-99ad-dad1e6c4cf89" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.446304] env[70879]: INFO networking_nsxv3.common.synchronization [None req-3c89c17d-eada-4a6f-b581-62f2a582fc92 None None] Enqueued Resource ID: 4fa02acf-6a18-4a43-a035-ab66102ba62f with Priority: HIGHEST for action port [ 795.446636] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fa02acf-6a18-4a43-a035-ab66102ba62f with Priority: HIGHEST for action port [ 795.447132] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fa02acf-6a18-4a43-a035-ab66102ba62f taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.447278] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fa02acf-6a18-4a43-a035-ab66102ba62f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.447434] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fa02acf-6a18-4a43-a035-ab66102ba62f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.447596] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fa02acf-6a18-4a43-a035-ab66102ba62f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.447672] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fa02acf-6a18-4a43-a035-ab66102ba62f',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.505260] env[70879]: INFO networking_nsxv3.common.synchronization [None req-d24d7838-424f-4c77-93f6-3144b00d63bb None None] Enqueued Resource ID: 4dde0a03-530e-4c71-8ca9-cf4271142903 with Priority: HIGHEST for action port [ 795.506735] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dde0a03-530e-4c71-8ca9-cf4271142903 with Priority: HIGHEST for action port [ 795.507192] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dde0a03-530e-4c71-8ca9-cf4271142903 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.507322] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dde0a03-530e-4c71-8ca9-cf4271142903" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.507398] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dde0a03-530e-4c71-8ca9-cf4271142903" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.507670] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dde0a03-530e-4c71-8ca9-cf4271142903" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.507755] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dde0a03-530e-4c71-8ca9-cf4271142903',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.949559] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fa02acf-6a18-4a43-a035-ab66102ba62f [ 795.949791] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.949927] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 795.949988] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.950243] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 795.950331] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 795.950438] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fa02acf-6a18-4a43-a035-ab66102ba62f already deleted. [ 795.950551] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fa02acf-6a18-4a43-a035-ab66102ba62f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.013842] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4dde0a03-530e-4c71-8ca9-cf4271142903 [ 796.013842] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.013842] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.013842] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.013842] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.013842] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.014102] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4dde0a03-530e-4c71-8ca9-cf4271142903 already deleted. [ 796.014102] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dde0a03-530e-4c71-8ca9-cf4271142903" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.343685] env[70879]: INFO networking_nsxv3.common.synchronization [None req-fc757874-e41e-4d15-a563-784420f90012 tempest-VolumesAdminNegativeTest-2069669008 tempest-VolumesAdminNegativeTest-2069669008-project-member] Enqueued Resource ID: c6afd009-0455-482f-abaa-3bd9b5eae840 with Priority: HIGHEST for action security_group_rules [ 796.343685] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6afd009-0455-482f-abaa-3bd9b5eae840 with Priority: HIGHEST for action security_group_rules [ 796.343685] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6afd009-0455-482f-abaa-3bd9b5eae840 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.343685] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6afd009-0455-482f-abaa-3bd9b5eae840" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.343685] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6afd009-0455-482f-abaa-3bd9b5eae840" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.344928] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6afd009-0455-482f-abaa-3bd9b5eae840" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.344928] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6afd009-0455-482f-abaa-3bd9b5eae840',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.570743] env[70879]: INFO networking_nsxv3.common.synchronization [None req-202d0836-9934-4c9b-94ae-4a938324b7df tempest-VolumesAdminNegativeTest-2069669008 tempest-VolumesAdminNegativeTest-2069669008-project-member] Enqueued Resource ID: c6afd009-0455-482f-abaa-3bd9b5eae840 with Priority: HIGHEST for action security_group_rules [ 796.571139] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6afd009-0455-482f-abaa-3bd9b5eae840 with Priority: HIGHEST for action security_group_rules [ 796.571397] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6afd009-0455-482f-abaa-3bd9b5eae840 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.571719] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6afd009-0455-482f-abaa-3bd9b5eae840" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.871605] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.871605] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 796.871605] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.871605] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.871605] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.871605] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6afd009-0455-482f-abaa-3bd9b5eae840 already deleted. [ 796.872098] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6afd009-0455-482f-abaa-3bd9b5eae840" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 796.872172] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6afd009-0455-482f-abaa-3bd9b5eae840" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.872283] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6afd009-0455-482f-abaa-3bd9b5eae840" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 796.872394] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6afd009-0455-482f-abaa-3bd9b5eae840',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.397592] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.397767] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 797.397767] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.399425] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 797.403899] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.403899] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6afd009-0455-482f-abaa-3bd9b5eae840 already deleted. [ 797.403899] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6afd009-0455-482f-abaa-3bd9b5eae840" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 797.999676] env[70879]: INFO networking_nsxv3.common.synchronization [None req-84ab6567-4373-41ac-84c8-850cc89da2b9 None None] Enqueued Resource ID: 47231216-8e89-45e3-87b1-3862cf9e73cb with Priority: HIGHEST for action port [ 797.999944] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47231216-8e89-45e3-87b1-3862cf9e73cb with Priority: HIGHEST for action port [ 798.001967] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-47231216-8e89-45e3-87b1-3862cf9e73cb taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.001967] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47231216-8e89-45e3-87b1-3862cf9e73cb" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.001967] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47231216-8e89-45e3-87b1-3862cf9e73cb" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.001967] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47231216-8e89-45e3-87b1-3862cf9e73cb" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.001967] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47231216-8e89-45e3-87b1-3862cf9e73cb',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.184424] env[70879]: INFO networking_nsxv3.common.synchronization [None req-f6231664-a531-4ebe-93af-11f42898bf55 None None] Enqueued Resource ID: 690c48b4-a885-4546-aef7-37ddbc647e29 with Priority: HIGHEST for action port [ 798.184424] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690c48b4-a885-4546-aef7-37ddbc647e29 with Priority: HIGHEST for action port [ 798.184424] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-690c48b4-a885-4546-aef7-37ddbc647e29 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.185393] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-690c48b4-a885-4546-aef7-37ddbc647e29" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.185491] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-690c48b4-a885-4546-aef7-37ddbc647e29" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.186074] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-690c48b4-a885-4546-aef7-37ddbc647e29" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.186167] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('690c48b4-a885-4546-aef7-37ddbc647e29',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.509910] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47231216-8e89-45e3-87b1-3862cf9e73cb [ 798.510168] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.510309] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.510511] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.510583] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.510670] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.510760] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47231216-8e89-45e3-87b1-3862cf9e73cb already deleted. [ 798.510837] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47231216-8e89-45e3-87b1-3862cf9e73cb" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.689241] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 690c48b4-a885-4546-aef7-37ddbc647e29 [ 798.689241] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.689406] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.689462] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.689640] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.689766] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.689831] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:690c48b4-a885-4546-aef7-37ddbc647e29 already deleted. [ 798.689898] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-690c48b4-a885-4546-aef7-37ddbc647e29" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 798.896441] env[70879]: INFO networking_nsxv3.common.synchronization [None req-dc6bc707-6640-486d-be6f-6afaf24916ae None None] Enqueued Resource ID: 3586680e-fea8-4c5d-9da3-69ec2f2afba9 with Priority: HIGHEST for action port [ 798.898697] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3586680e-fea8-4c5d-9da3-69ec2f2afba9 with Priority: HIGHEST for action port [ 798.899126] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-3586680e-fea8-4c5d-9da3-69ec2f2afba9 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.899396] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3586680e-fea8-4c5d-9da3-69ec2f2afba9" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 798.899472] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3586680e-fea8-4c5d-9da3-69ec2f2afba9" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.899757] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3586680e-fea8-4c5d-9da3-69ec2f2afba9" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 798.899837] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3586680e-fea8-4c5d-9da3-69ec2f2afba9',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.404453] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3586680e-fea8-4c5d-9da3-69ec2f2afba9 [ 799.404453] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.406648] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.406648] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.406648] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.406648] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.406648] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3586680e-fea8-4c5d-9da3-69ec2f2afba9 already deleted. [ 799.406648] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3586680e-fea8-4c5d-9da3-69ec2f2afba9" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 799.812694] env[70879]: INFO networking_nsxv3.common.synchronization [req-93ddcf30-3243-4e3c-af78-65f0658910bd req-c7cdef12-47f2-4b6d-9436-c83c78baed3a tempest-SecurityGroupRulesTestJSON-687639067 tempest-SecurityGroupRulesTestJSON-687639067-project-member] Enqueued Resource ID: fcdc938a-234b-4b53-8932-2c5316768082 with Priority: HIGHEST for action security_group_rules [ 799.813250] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdc938a-234b-4b53-8932-2c5316768082 with Priority: HIGHEST for action security_group_rules [ 799.813542] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcdc938a-234b-4b53-8932-2c5316768082 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.813661] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcdc938a-234b-4b53-8932-2c5316768082" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.813743] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcdc938a-234b-4b53-8932-2c5316768082" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.814031] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcdc938a-234b-4b53-8932-2c5316768082" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.816196] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcdc938a-234b-4b53-8932-2c5316768082',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.839748] env[70879]: INFO networking_nsxv3.common.synchronization [None req-54fe364b-2357-4c7f-ae7e-b3a66ec141aa None None] Enqueued Resource ID: 1e44acab-f2e8-45ab-835f-b0f5e96d37e3 with Priority: HIGHEST for action port [ 799.840537] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e44acab-f2e8-45ab-835f-b0f5e96d37e3 with Priority: HIGHEST for action port [ 799.840611] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e44acab-f2e8-45ab-835f-b0f5e96d37e3 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.840730] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e44acab-f2e8-45ab-835f-b0f5e96d37e3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 799.840798] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e44acab-f2e8-45ab-835f-b0f5e96d37e3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.841609] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e44acab-f2e8-45ab-835f-b0f5e96d37e3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 799.841708] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e44acab-f2e8-45ab-835f-b0f5e96d37e3',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.340934] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.341160] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.341160] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.341365] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.341509] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.341598] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcdc938a-234b-4b53-8932-2c5316768082 already deleted. [ 800.341683] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcdc938a-234b-4b53-8932-2c5316768082" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.344631] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e44acab-f2e8-45ab-835f-b0f5e96d37e3 [ 800.344631] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.344631] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 800.344631] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.344848] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 800.344848] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 800.344848] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e44acab-f2e8-45ab-835f-b0f5e96d37e3 already deleted. [ 800.344947] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e44acab-f2e8-45ab-835f-b0f5e96d37e3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.335335] env[70879]: INFO networking_nsxv3.common.synchronization [None req-9199521e-0f87-42d2-8035-038d216d79ea None None] Enqueued Resource ID: dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1 with Priority: HIGHEST for action port [ 802.335808] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1 with Priority: HIGHEST for action port [ 802.336345] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.336475] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.336543] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.336851] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.336897] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.840760] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1 [ 802.842723] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.842937] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 802.843041] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.843822] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 802.843962] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 802.844083] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1 already deleted. [ 802.844409] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc798d1e-205f-4e7c-8963-f8ccb7dc1fe1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.047835] env[70879]: INFO networking_nsxv3.common.synchronization [None req-5e6e5fce-c455-4cca-a4cc-ffa004edf211 None None] Enqueued Resource ID: 31967984-917f-42a2-99d3-6f646543398c with Priority: HIGHEST for action port [ 803.048322] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31967984-917f-42a2-99d3-6f646543398c with Priority: HIGHEST for action port [ 803.048859] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-31967984-917f-42a2-99d3-6f646543398c taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.048859] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31967984-917f-42a2-99d3-6f646543398c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.048859] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31967984-917f-42a2-99d3-6f646543398c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.049164] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31967984-917f-42a2-99d3-6f646543398c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.050899] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31967984-917f-42a2-99d3-6f646543398c',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.553139] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31967984-917f-42a2-99d3-6f646543398c [ 803.553139] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.553139] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 803.553139] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.553139] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 803.553139] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 803.553139] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31967984-917f-42a2-99d3-6f646543398c already deleted. [ 803.553139] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31967984-917f-42a2-99d3-6f646543398c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 804.708029] env[70879]: INFO networking_nsxv3.common.synchronization [None req-2d21099b-1aa2-4fba-b4bf-5f8c34c1c9df None None] Enqueued Resource ID: 9ec93420-f529-4b0f-a73b-f9650898c690 with Priority: HIGHEST for action port [ 804.709535] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ec93420-f529-4b0f-a73b-f9650898c690 with Priority: HIGHEST for action port [ 804.712789] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ec93420-f529-4b0f-a73b-f9650898c690 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.712928] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ec93420-f529-4b0f-a73b-f9650898c690" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 804.713040] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ec93420-f529-4b0f-a73b-f9650898c690" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.713285] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ec93420-f529-4b0f-a73b-f9650898c690" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 804.713359] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ec93420-f529-4b0f-a73b-f9650898c690',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.192391] env[70879]: INFO networking_nsxv3.common.synchronization [None req-c27f34aa-b9e4-407f-84b5-974e96e27f1e None None] Enqueued Resource ID: 3fd006cb-17ab-413c-8d69-047ef3844998 with Priority: HIGHEST for action port [ 805.192656] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd006cb-17ab-413c-8d69-047ef3844998 with Priority: HIGHEST for action port [ 805.193235] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd006cb-17ab-413c-8d69-047ef3844998 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.193374] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd006cb-17ab-413c-8d69-047ef3844998" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.193418] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd006cb-17ab-413c-8d69-047ef3844998" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.194161] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd006cb-17ab-413c-8d69-047ef3844998" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.194161] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd006cb-17ab-413c-8d69-047ef3844998',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.216855] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ec93420-f529-4b0f-a73b-f9650898c690 [ 805.218578] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.218578] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.218578] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.218578] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.218578] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.218578] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ec93420-f529-4b0f-a73b-f9650898c690 already deleted. [ 805.218578] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ec93420-f529-4b0f-a73b-f9650898c690" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.699399] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fd006cb-17ab-413c-8d69-047ef3844998 [ 805.699635] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.699772] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 805.699947] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.700070] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 805.700161] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 805.700254] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fd006cb-17ab-413c-8d69-047ef3844998 already deleted. [ 805.700351] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd006cb-17ab-413c-8d69-047ef3844998" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.351585] env[70879]: INFO networking_nsxv3.common.synchronization [None req-22e0f4fe-4472-4d05-b4ed-0874ba097b69 None None] Enqueued Resource ID: 7b906cf2-9cea-4af6-90d5-78efab526d6f with Priority: HIGHEST for action port [ 806.352287] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b906cf2-9cea-4af6-90d5-78efab526d6f with Priority: HIGHEST for action port [ 806.353452] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b906cf2-9cea-4af6-90d5-78efab526d6f taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.353452] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b906cf2-9cea-4af6-90d5-78efab526d6f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.353649] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b906cf2-9cea-4af6-90d5-78efab526d6f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.353758] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b906cf2-9cea-4af6-90d5-78efab526d6f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.353837] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b906cf2-9cea-4af6-90d5-78efab526d6f',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.857733] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b906cf2-9cea-4af6-90d5-78efab526d6f [ 806.857733] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.857733] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 806.857733] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.857733] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 806.857733] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 806.857733] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b906cf2-9cea-4af6-90d5-78efab526d6f already deleted. [ 806.857733] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b906cf2-9cea-4af6-90d5-78efab526d6f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 807.773211] env[70879]: INFO networking_nsxv3.common.synchronization [None req-f4656713-13d2-4a08-9887-03992d24c326 None None] Enqueued Resource ID: 36ea21ee-bbf8-416d-bd20-b9b6d37cd00f with Priority: HIGHEST for action port [ 807.773450] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36ea21ee-bbf8-416d-bd20-b9b6d37cd00f with Priority: HIGHEST for action port [ 807.773900] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-36ea21ee-bbf8-416d-bd20-b9b6d37cd00f taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.774093] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36ea21ee-bbf8-416d-bd20-b9b6d37cd00f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.774134] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36ea21ee-bbf8-416d-bd20-b9b6d37cd00f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.774358] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36ea21ee-bbf8-416d-bd20-b9b6d37cd00f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.774439] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36ea21ee-bbf8-416d-bd20-b9b6d37cd00f',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.865275] env[70879]: INFO networking_nsxv3.common.synchronization [None req-c27a271c-3165-4c90-a1de-06f3cd79dbc0 None None] Enqueued Resource ID: 251d5d46-7843-4255-beb0-ad0fb59b95ec with Priority: HIGHEST for action port [ 807.865275] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 251d5d46-7843-4255-beb0-ad0fb59b95ec with Priority: HIGHEST for action port [ 807.865275] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-251d5d46-7843-4255-beb0-ad0fb59b95ec taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.865275] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-251d5d46-7843-4255-beb0-ad0fb59b95ec" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 807.865275] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-251d5d46-7843-4255-beb0-ad0fb59b95ec" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.865275] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-251d5d46-7843-4255-beb0-ad0fb59b95ec" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 807.865275] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('251d5d46-7843-4255-beb0-ad0fb59b95ec',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.278917] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36ea21ee-bbf8-416d-bd20-b9b6d37cd00f [ 808.279585] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.279585] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.279585] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.279796] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.281513] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.281513] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36ea21ee-bbf8-416d-bd20-b9b6d37cd00f already deleted. [ 808.281513] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36ea21ee-bbf8-416d-bd20-b9b6d37cd00f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.369782] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 251d5d46-7843-4255-beb0-ad0fb59b95ec [ 808.369782] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.369782] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 808.369782] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.369782] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 808.369782] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 808.369782] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:251d5d46-7843-4255-beb0-ad0fb59b95ec already deleted. [ 808.369782] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-251d5d46-7843-4255-beb0-ad0fb59b95ec" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.124138] env[70879]: INFO networking_nsxv3.common.synchronization [req-0cde113e-235e-4502-8386-7db420f2aace req-0b04f2c8-1036-47a6-846d-779a961c7018 tempest-SecurityGroupRulesTestJSON-687639067 tempest-SecurityGroupRulesTestJSON-687639067-project-member] Enqueued Resource ID: 22dad9c3-88a6-4d18-bc22-09a626ecce87 with Priority: HIGHEST for action security_group_rules [ 810.124963] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22dad9c3-88a6-4d18-bc22-09a626ecce87 with Priority: HIGHEST for action security_group_rules [ 810.125166] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22dad9c3-88a6-4d18-bc22-09a626ecce87 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.125251] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22dad9c3-88a6-4d18-bc22-09a626ecce87" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.125317] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22dad9c3-88a6-4d18-bc22-09a626ecce87" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.125715] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22dad9c3-88a6-4d18-bc22-09a626ecce87" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.125715] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22dad9c3-88a6-4d18-bc22-09a626ecce87',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.209784] env[70879]: INFO networking_nsxv3.common.synchronization [None req-76033808-6461-48da-8d63-59e0d16b5f4e None None] Enqueued Resource ID: 5ecc3789-d195-4b97-a0e6-6ece944d0f77 with Priority: HIGHEST for action port [ 810.209784] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ecc3789-d195-4b97-a0e6-6ece944d0f77 with Priority: HIGHEST for action port [ 810.209784] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ecc3789-d195-4b97-a0e6-6ece944d0f77 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.209784] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ecc3789-d195-4b97-a0e6-6ece944d0f77" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.209784] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ecc3789-d195-4b97-a0e6-6ece944d0f77" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.209784] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ecc3789-d195-4b97-a0e6-6ece944d0f77" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.209784] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ecc3789-d195-4b97-a0e6-6ece944d0f77',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.654326] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.654326] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.654326] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.654326] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.654326] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.654326] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22dad9c3-88a6-4d18-bc22-09a626ecce87 already deleted. [ 810.654326] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22dad9c3-88a6-4d18-bc22-09a626ecce87" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.713061] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ecc3789-d195-4b97-a0e6-6ece944d0f77 [ 810.714266] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.714266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 810.714266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.714266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 810.714266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 810.714266] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ecc3789-d195-4b97-a0e6-6ece944d0f77 already deleted. [ 810.714266] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ecc3789-d195-4b97-a0e6-6ece944d0f77" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.317616] env[70879]: INFO networking_nsxv3.common.synchronization [None req-086ac3cb-7c75-4959-bbae-a34cd942fcd3 None None] Enqueued Resource ID: f4170196-e1ed-47ff-b89b-e707de824da3 with Priority: HIGHEST for action port [ 811.318548] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4170196-e1ed-47ff-b89b-e707de824da3 with Priority: HIGHEST for action port [ 811.318548] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4170196-e1ed-47ff-b89b-e707de824da3 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.318696] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4170196-e1ed-47ff-b89b-e707de824da3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.318737] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4170196-e1ed-47ff-b89b-e707de824da3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.319367] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4170196-e1ed-47ff-b89b-e707de824da3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.319458] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4170196-e1ed-47ff-b89b-e707de824da3',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.824102] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4170196-e1ed-47ff-b89b-e707de824da3 [ 811.824352] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.824474] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 811.824542] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.824797] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 811.824867] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 811.824961] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4170196-e1ed-47ff-b89b-e707de824da3 already deleted. [ 811.825051] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4170196-e1ed-47ff-b89b-e707de824da3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.102032] env[70879]: INFO networking_nsxv3.common.synchronization [None req-29a3bff4-360a-495d-908f-efc11c2f4bc7 None None] Enqueued Resource ID: 13873d7d-344d-44a6-a1f0-4d427c732908 with Priority: HIGHEST for action port [ 813.102332] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13873d7d-344d-44a6-a1f0-4d427c732908 with Priority: HIGHEST for action port [ 813.102949] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-13873d7d-344d-44a6-a1f0-4d427c732908 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.102949] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13873d7d-344d-44a6-a1f0-4d427c732908" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.103287] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13873d7d-344d-44a6-a1f0-4d427c732908" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.103287] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13873d7d-344d-44a6-a1f0-4d427c732908" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.103371] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13873d7d-344d-44a6-a1f0-4d427c732908',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.585441] env[70879]: INFO networking_nsxv3.common.synchronization [None req-28cb3225-58c8-4bdf-8837-6dd823386c47 tempest-ServerActionsTestJSON-2115697812 tempest-ServerActionsTestJSON-2115697812-project-member] Enqueued Resource ID: 34d30a6d-5890-4805-ad81-2074bd01b389 with Priority: HIGHEST for action security_group_rules [ 813.585833] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d30a6d-5890-4805-ad81-2074bd01b389 with Priority: HIGHEST for action security_group_rules [ 813.590033] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34d30a6d-5890-4805-ad81-2074bd01b389 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.590033] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34d30a6d-5890-4805-ad81-2074bd01b389" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.590033] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34d30a6d-5890-4805-ad81-2074bd01b389" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.590033] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34d30a6d-5890-4805-ad81-2074bd01b389" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.590033] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34d30a6d-5890-4805-ad81-2074bd01b389',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.608639] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13873d7d-344d-44a6-a1f0-4d427c732908 [ 813.608639] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.608639] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 813.608639] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.608639] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 813.608639] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 813.608639] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13873d7d-344d-44a6-a1f0-4d427c732908 already deleted. [ 813.608639] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13873d7d-344d-44a6-a1f0-4d427c732908" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.114690] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.114983] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.114983] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.115714] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.115714] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.115714] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34d30a6d-5890-4805-ad81-2074bd01b389 already deleted. [ 814.115714] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34d30a6d-5890-4805-ad81-2074bd01b389" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.156820] env[70879]: INFO networking_nsxv3.common.synchronization [None req-45783d90-0451-4323-ab76-a12f71f1cc0d tempest-ServerActionsTestJSON-2115697812 tempest-ServerActionsTestJSON-2115697812-project-member] Enqueued Resource ID: 34d30a6d-5890-4805-ad81-2074bd01b389 with Priority: HIGHEST for action security_group_rules [ 814.157059] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d30a6d-5890-4805-ad81-2074bd01b389 with Priority: HIGHEST for action security_group_rules [ 814.157312] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34d30a6d-5890-4805-ad81-2074bd01b389 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.157450] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34d30a6d-5890-4805-ad81-2074bd01b389" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.157518] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34d30a6d-5890-4805-ad81-2074bd01b389" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.157713] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34d30a6d-5890-4805-ad81-2074bd01b389" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.159115] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34d30a6d-5890-4805-ad81-2074bd01b389',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.319726] env[70879]: INFO networking_nsxv3.common.synchronization [None req-617ffbf2-b3e2-4ba6-aff9-cfc3c925d6d2 None None] Enqueued Resource ID: 351d6e85-fcaf-4aca-910c-aed080d3bfc1 with Priority: HIGHEST for action port [ 814.320018] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351d6e85-fcaf-4aca-910c-aed080d3bfc1 with Priority: HIGHEST for action port [ 814.320567] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-351d6e85-fcaf-4aca-910c-aed080d3bfc1 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.320715] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-351d6e85-fcaf-4aca-910c-aed080d3bfc1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.321666] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-351d6e85-fcaf-4aca-910c-aed080d3bfc1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.322040] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-351d6e85-fcaf-4aca-910c-aed080d3bfc1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.322214] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('351d6e85-fcaf-4aca-910c-aed080d3bfc1',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.342011] env[70879]: INFO networking_nsxv3.common.synchronization [None req-285aae2a-4a62-4872-9adb-9876185f5eb4 None None] Enqueued Resource ID: a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6 with Priority: HIGHEST for action port [ 814.342836] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6 with Priority: HIGHEST for action port [ 814.342922] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.343014] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.343189] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.343476] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.343559] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.682779] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.688255] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.688255] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.688255] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.688255] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.688255] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34d30a6d-5890-4805-ad81-2074bd01b389 already deleted. [ 814.688255] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34d30a6d-5890-4805-ad81-2074bd01b389" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.825518] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 351d6e85-fcaf-4aca-910c-aed080d3bfc1 [ 814.825799] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.825933] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.826205] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.826452] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.826541] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.826686] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:351d6e85-fcaf-4aca-910c-aed080d3bfc1 already deleted. [ 814.826767] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-351d6e85-fcaf-4aca-910c-aed080d3bfc1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.845903] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6 [ 814.846269] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.846432] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 814.846519] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.846999] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 814.847111] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 814.847250] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6 already deleted. [ 814.847371] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a79db1e6-5c24-4cbf-942c-0c2a09d1c3c6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 816.535717] env[70879]: INFO networking_nsxv3.common.synchronization [None req-4eb252b6-be33-44e2-bcd4-9f26cec69066 tempest-ServersTestBootFromVolume-829180337 tempest-ServersTestBootFromVolume-829180337-project-member] Enqueued Resource ID: 978b57ef-5adb-42b8-bfda-cb5cda84a5c0 with Priority: HIGHEST for action security_group_rules [ 816.537296] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 978b57ef-5adb-42b8-bfda-cb5cda84a5c0 with Priority: HIGHEST for action security_group_rules [ 816.537296] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.537296] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 816.537296] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.543297] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 816.543297] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('978b57ef-5adb-42b8-bfda-cb5cda84a5c0',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.878508] env[70879]: INFO networking_nsxv3.common.synchronization [None req-7c1bdfd3-cae7-407e-9667-0325219eae71 tempest-ServersTestBootFromVolume-829180337 tempest-ServersTestBootFromVolume-829180337-project-member] Enqueued Resource ID: 978b57ef-5adb-42b8-bfda-cb5cda84a5c0 with Priority: HIGHEST for action security_group_rules [ 816.879197] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 978b57ef-5adb-42b8-bfda-cb5cda84a5c0 with Priority: HIGHEST for action security_group_rules [ 816.879732] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.879996] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.003752] env[70879]: INFO networking_nsxv3.common.synchronization [None req-131a28e7-6a4d-41f2-9183-58f4f66fc734 None None] Enqueued Resource ID: ad248fc6-fe7b-4bf9-960e-e8d88768b282 with Priority: HIGHEST for action port [ 817.005594] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad248fc6-fe7b-4bf9-960e-e8d88768b282 with Priority: HIGHEST for action port [ 817.007291] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad248fc6-fe7b-4bf9-960e-e8d88768b282 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.007505] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad248fc6-fe7b-4bf9-960e-e8d88768b282" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.007785] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad248fc6-fe7b-4bf9-960e-e8d88768b282" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.008107] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad248fc6-fe7b-4bf9-960e-e8d88768b282" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.008242] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad248fc6-fe7b-4bf9-960e-e8d88768b282',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.065373] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.065541] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.065647] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.065936] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.066098] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.066201] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 978b57ef-5adb-42b8-bfda-cb5cda84a5c0 already deleted. [ 817.066323] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.066484] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.069467] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.069467] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('978b57ef-5adb-42b8-bfda-cb5cda84a5c0',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.510229] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad248fc6-fe7b-4bf9-960e-e8d88768b282 [ 817.510469] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.511195] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.511275] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.511556] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.511647] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.511760] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad248fc6-fe7b-4bf9-960e-e8d88768b282 already deleted. [ 817.511821] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad248fc6-fe7b-4bf9-960e-e8d88768b282" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.587490] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.587815] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 817.587815] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.587957] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 817.588078] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 817.588172] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 978b57ef-5adb-42b8-bfda-cb5cda84a5c0 already deleted. [ 817.588256] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-978b57ef-5adb-42b8-bfda-cb5cda84a5c0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.385554] env[70879]: INFO networking_nsxv3.common.synchronization [None req-b2cb5c60-0e42-4c0e-8d99-58c5c423a7b5 None None] Enqueued Resource ID: a6b8d32e-e78a-4103-a8d2-7c248bdb9378 with Priority: HIGHEST for action port [ 818.385878] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b8d32e-e78a-4103-a8d2-7c248bdb9378 with Priority: HIGHEST for action port [ 818.386480] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6b8d32e-e78a-4103-a8d2-7c248bdb9378 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.386596] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6b8d32e-e78a-4103-a8d2-7c248bdb9378" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.386636] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6b8d32e-e78a-4103-a8d2-7c248bdb9378" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.386853] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6b8d32e-e78a-4103-a8d2-7c248bdb9378" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.386934] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6b8d32e-e78a-4103-a8d2-7c248bdb9378',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.549608] env[70879]: INFO networking_nsxv3.common.synchronization [None req-da3993fc-2432-417c-9d97-fed5970c41d9 None None] Enqueued Resource ID: 1c2cce85-fd31-47bf-84d5-454d0be33edd with Priority: HIGHEST for action port [ 818.549816] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2cce85-fd31-47bf-84d5-454d0be33edd with Priority: HIGHEST for action port [ 818.550844] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c2cce85-fd31-47bf-84d5-454d0be33edd taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.550844] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c2cce85-fd31-47bf-84d5-454d0be33edd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.550844] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c2cce85-fd31-47bf-84d5-454d0be33edd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.550844] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c2cce85-fd31-47bf-84d5-454d0be33edd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.551568] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c2cce85-fd31-47bf-84d5-454d0be33edd',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.890819] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6b8d32e-e78a-4103-a8d2-7c248bdb9378 [ 818.890819] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.890819] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 818.890819] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.891292] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 818.891292] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 818.891292] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6b8d32e-e78a-4103-a8d2-7c248bdb9378 already deleted. [ 818.891292] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6b8d32e-e78a-4103-a8d2-7c248bdb9378" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.056416] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c2cce85-fd31-47bf-84d5-454d0be33edd [ 819.056416] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.056416] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 819.056604] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.058638] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 819.058638] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 819.058638] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c2cce85-fd31-47bf-84d5-454d0be33edd already deleted. [ 819.058638] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c2cce85-fd31-47bf-84d5-454d0be33edd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.457630] env[70879]: INFO networking_nsxv3.common.synchronization [None req-c307de4a-9a3e-4322-8690-0baf59e59be0 tempest-AttachInterfacesTestJSON-909183734 tempest-AttachInterfacesTestJSON-909183734-project-member] Enqueued Resource ID: 3832b3a4-683d-463b-91fa-3cf5bf35e805 with Priority: HIGHEST for action security_group_rules [ 820.457630] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3832b3a4-683d-463b-91fa-3cf5bf35e805 with Priority: HIGHEST for action security_group_rules [ 820.457630] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3832b3a4-683d-463b-91fa-3cf5bf35e805 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.458032] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3832b3a4-683d-463b-91fa-3cf5bf35e805" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.458032] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3832b3a4-683d-463b-91fa-3cf5bf35e805" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.458463] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3832b3a4-683d-463b-91fa-3cf5bf35e805" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.458463] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3832b3a4-683d-463b-91fa-3cf5bf35e805',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.801665] env[70879]: INFO networking_nsxv3.common.synchronization [None req-6999b34f-e4ab-4560-b722-c3e934322d78 tempest-AttachInterfacesTestJSON-909183734 tempest-AttachInterfacesTestJSON-909183734-project-member] Enqueued Resource ID: 3832b3a4-683d-463b-91fa-3cf5bf35e805 with Priority: HIGHEST for action security_group_rules [ 820.801771] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3832b3a4-683d-463b-91fa-3cf5bf35e805 with Priority: HIGHEST for action security_group_rules [ 820.803022] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3832b3a4-683d-463b-91fa-3cf5bf35e805 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.803022] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3832b3a4-683d-463b-91fa-3cf5bf35e805" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.856020] env[70879]: INFO networking_nsxv3.common.synchronization [None req-6e1174e8-19c5-4eee-9edd-912068140bc6 None None] Enqueued Resource ID: 032a48ff-0462-4104-b4dd-3b140eb8e8fd with Priority: HIGHEST for action port [ 820.856644] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032a48ff-0462-4104-b4dd-3b140eb8e8fd with Priority: HIGHEST for action port [ 820.856986] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-032a48ff-0462-4104-b4dd-3b140eb8e8fd taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.857587] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-032a48ff-0462-4104-b4dd-3b140eb8e8fd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.857664] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-032a48ff-0462-4104-b4dd-3b140eb8e8fd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.858176] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-032a48ff-0462-4104-b4dd-3b140eb8e8fd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.858243] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('032a48ff-0462-4104-b4dd-3b140eb8e8fd',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.985475] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.985475] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 820.985475] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.985644] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.985742] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.985810] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3832b3a4-683d-463b-91fa-3cf5bf35e805 already deleted. [ 820.985943] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3832b3a4-683d-463b-91fa-3cf5bf35e805" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 820.986158] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3832b3a4-683d-463b-91fa-3cf5bf35e805" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.986574] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3832b3a4-683d-463b-91fa-3cf5bf35e805" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 820.986574] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3832b3a4-683d-463b-91fa-3cf5bf35e805',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.363561] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 032a48ff-0462-4104-b4dd-3b140eb8e8fd [ 821.363847] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.363934] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.364030] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.364341] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.364341] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.364427] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:032a48ff-0462-4104-b4dd-3b140eb8e8fd already deleted. [ 821.364490] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-032a48ff-0462-4104-b4dd-3b140eb8e8fd" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.439267] env[70879]: INFO networking_nsxv3.common.synchronization [None req-6c85d6a8-9834-4e18-b2b6-5ff48f6c19bc None None] Enqueued Resource ID: 21cec029-f76c-4d50-9f94-effdefa2e634 with Priority: HIGHEST for action port [ 821.439561] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21cec029-f76c-4d50-9f94-effdefa2e634 with Priority: HIGHEST for action port [ 821.440077] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-21cec029-f76c-4d50-9f94-effdefa2e634 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.440213] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21cec029-f76c-4d50-9f94-effdefa2e634" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.440364] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21cec029-f76c-4d50-9f94-effdefa2e634" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.440540] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21cec029-f76c-4d50-9f94-effdefa2e634" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.440732] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21cec029-f76c-4d50-9f94-effdefa2e634',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.511033] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.511365] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.511365] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.511486] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.511687] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.511788] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3832b3a4-683d-463b-91fa-3cf5bf35e805 already deleted. [ 821.511983] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3832b3a4-683d-463b-91fa-3cf5bf35e805" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.944030] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21cec029-f76c-4d50-9f94-effdefa2e634 [ 821.944030] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.944030] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 821.944030] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.944030] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 821.944030] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 821.944030] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21cec029-f76c-4d50-9f94-effdefa2e634 already deleted. [ 821.944030] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21cec029-f76c-4d50-9f94-effdefa2e634" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.096725] env[70879]: INFO networking_nsxv3.common.synchronization [req-a5c81155-206f-4237-ab17-c3acf8f20ee2 req-f692eedc-7209-4827-9e5d-6cfbc6de4a2f tempest-SecurityGroupRulesTestJSON-687639067 tempest-SecurityGroupRulesTestJSON-687639067-project-member] Enqueued Resource ID: 8614dc07-77e6-47ce-9d9f-9087a444a4e2 with Priority: HIGHEST for action security_group_rules [ 822.097264] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8614dc07-77e6-47ce-9d9f-9087a444a4e2 with Priority: HIGHEST for action security_group_rules [ 822.097563] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.097755] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.097883] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.100250] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.100250] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8614dc07-77e6-47ce-9d9f-9087a444a4e2',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.625295] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.625295] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 822.625768] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.625768] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 822.625768] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 822.625768] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8614dc07-77e6-47ce-9d9f-9087a444a4e2 already deleted. [ 822.625876] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 824.605488] env[70879]: INFO networking_nsxv3.common.synchronization [req-016eb9c4-bc14-4623-a5ac-c183ef43ef70 req-9412ee1e-8be5-407b-a827-e0a50dc127a8 tempest-SecurityGroupRulesTestJSON-687639067 tempest-SecurityGroupRulesTestJSON-687639067-project-member] Enqueued Resource ID: 8614dc07-77e6-47ce-9d9f-9087a444a4e2 with Priority: HIGHEST for action security_group_rules [ 824.606176] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8614dc07-77e6-47ce-9d9f-9087a444a4e2 with Priority: HIGHEST for action security_group_rules [ 824.606408] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.606534] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.606612] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.606819] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.606931] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8614dc07-77e6-47ce-9d9f-9087a444a4e2',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.825845] env[70879]: INFO networking_nsxv3.common.synchronization [None req-8097535b-edbd-4a61-8b57-d2afd8e617f9 None None] Enqueued Resource ID: f01687dd-61f9-452b-a88f-5e925cc7bf5a with Priority: HIGHEST for action port [ 824.825845] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f01687dd-61f9-452b-a88f-5e925cc7bf5a with Priority: HIGHEST for action port [ 824.825845] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-f01687dd-61f9-452b-a88f-5e925cc7bf5a taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.825845] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f01687dd-61f9-452b-a88f-5e925cc7bf5a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 824.825845] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f01687dd-61f9-452b-a88f-5e925cc7bf5a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.825845] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f01687dd-61f9-452b-a88f-5e925cc7bf5a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 824.825845] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f01687dd-61f9-452b-a88f-5e925cc7bf5a',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.133408] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.133527] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.133876] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.133876] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.133876] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.134162] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8614dc07-77e6-47ce-9d9f-9087a444a4e2 already deleted. [ 825.134162] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.312766] env[70879]: INFO networking_nsxv3.common.synchronization [None req-149282a9-e416-4be3-9d3d-9c824761ca2c None None] Enqueued Resource ID: 07196d92-385d-41d7-b0bf-07094db098ae with Priority: HIGHEST for action port [ 825.313601] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07196d92-385d-41d7-b0bf-07094db098ae with Priority: HIGHEST for action port [ 825.313601] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-07196d92-385d-41d7-b0bf-07094db098ae taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.313745] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07196d92-385d-41d7-b0bf-07094db098ae" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.314984] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07196d92-385d-41d7-b0bf-07094db098ae" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.314984] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07196d92-385d-41d7-b0bf-07094db098ae" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.314984] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07196d92-385d-41d7-b0bf-07094db098ae',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.330512] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f01687dd-61f9-452b-a88f-5e925cc7bf5a [ 825.330512] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.330512] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.330512] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.330512] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.330512] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.330512] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f01687dd-61f9-452b-a88f-5e925cc7bf5a already deleted. [ 825.330512] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f01687dd-61f9-452b-a88f-5e925cc7bf5a" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.817581] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07196d92-385d-41d7-b0bf-07094db098ae [ 825.817834] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.818442] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.818442] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.818442] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.818442] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.818442] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07196d92-385d-41d7-b0bf-07094db098ae already deleted. [ 825.818442] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07196d92-385d-41d7-b0bf-07094db098ae" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 825.902777] env[70879]: INFO networking_nsxv3.common.synchronization [None req-591924af-e5d6-4d60-bf68-ea0802560528 None None] Enqueued Resource ID: 4377fb94-be66-4275-8068-82c7dafb0c4c with Priority: HIGHEST for action port [ 825.903709] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4377fb94-be66-4275-8068-82c7dafb0c4c with Priority: HIGHEST for action port [ 825.903886] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-4377fb94-be66-4275-8068-82c7dafb0c4c taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.904045] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4377fb94-be66-4275-8068-82c7dafb0c4c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 825.904118] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4377fb94-be66-4275-8068-82c7dafb0c4c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.904400] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4377fb94-be66-4275-8068-82c7dafb0c4c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 825.904642] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4377fb94-be66-4275-8068-82c7dafb0c4c',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.407987] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4377fb94-be66-4275-8068-82c7dafb0c4c [ 826.409755] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.409755] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.409755] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.409755] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.409755] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.409755] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4377fb94-be66-4275-8068-82c7dafb0c4c already deleted. [ 826.409755] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4377fb94-be66-4275-8068-82c7dafb0c4c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.470205] env[70879]: INFO networking_nsxv3.common.synchronization [None req-27c7b36f-abcd-4806-8d5b-67ae0aa9b28a tempest-AttachVolumeNegativeTest-2106626094 tempest-AttachVolumeNegativeTest-2106626094-project-member] Enqueued Resource ID: e1ddfee6-6476-4178-b1c5-2786d8bad942 with Priority: HIGHEST for action security_group_rules [ 826.472801] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1ddfee6-6476-4178-b1c5-2786d8bad942 with Priority: HIGHEST for action security_group_rules [ 826.472801] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1ddfee6-6476-4178-b1c5-2786d8bad942 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.472801] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1ddfee6-6476-4178-b1c5-2786d8bad942" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.472801] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1ddfee6-6476-4178-b1c5-2786d8bad942" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.472801] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1ddfee6-6476-4178-b1c5-2786d8bad942" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.472801] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1ddfee6-6476-4178-b1c5-2786d8bad942',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.552977] env[70879]: INFO networking_nsxv3.common.synchronization [None req-13726c3d-6313-4a36-9cb4-394e8d8b2a27 None None] Enqueued Resource ID: 9808d055-7278-4894-b266-405678d9df04 with Priority: HIGHEST for action port [ 826.553622] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9808d055-7278-4894-b266-405678d9df04 with Priority: HIGHEST for action port [ 826.553798] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-9808d055-7278-4894-b266-405678d9df04 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.553924] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9808d055-7278-4894-b266-405678d9df04" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.553992] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9808d055-7278-4894-b266-405678d9df04" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.554312] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9808d055-7278-4894-b266-405678d9df04" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.554436] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9808d055-7278-4894-b266-405678d9df04',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.921832] env[70879]: INFO networking_nsxv3.common.synchronization [None req-f98a4a13-b054-4446-b606-8b4258569608 tempest-AttachVolumeNegativeTest-2106626094 tempest-AttachVolumeNegativeTest-2106626094-project-member] Enqueued Resource ID: e1ddfee6-6476-4178-b1c5-2786d8bad942 with Priority: HIGHEST for action security_group_rules [ 826.922948] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1ddfee6-6476-4178-b1c5-2786d8bad942 with Priority: HIGHEST for action security_group_rules [ 826.923363] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1ddfee6-6476-4178-b1c5-2786d8bad942 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.923512] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1ddfee6-6476-4178-b1c5-2786d8bad942" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.998166] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.998309] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 826.998453] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.998887] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.998887] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.998887] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1ddfee6-6476-4178-b1c5-2786d8bad942 already deleted. [ 826.998887] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1ddfee6-6476-4178-b1c5-2786d8bad942" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 826.999428] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1ddfee6-6476-4178-b1c5-2786d8bad942" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.999428] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1ddfee6-6476-4178-b1c5-2786d8bad942" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 826.999428] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1ddfee6-6476-4178-b1c5-2786d8bad942',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.059268] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9808d055-7278-4894-b266-405678d9df04 [ 827.059268] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.059268] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.059268] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.059268] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.059268] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.059268] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9808d055-7278-4894-b266-405678d9df04 already deleted. [ 827.059268] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9808d055-7278-4894-b266-405678d9df04" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.528305] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.528305] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.528305] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.528305] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.528305] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.528305] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1ddfee6-6476-4178-b1c5-2786d8bad942 already deleted. [ 827.528305] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1ddfee6-6476-4178-b1c5-2786d8bad942" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 827.566175] env[70879]: INFO networking_nsxv3.common.synchronization [None req-fecbecf7-5ff9-4a92-878c-68d294c9224f None None] Enqueued Resource ID: b6a25aaa-e879-47db-855d-8a2771fec9ae with Priority: HIGHEST for action port [ 827.566704] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a25aaa-e879-47db-855d-8a2771fec9ae with Priority: HIGHEST for action port [ 827.567014] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6a25aaa-e879-47db-855d-8a2771fec9ae taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.567171] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6a25aaa-e879-47db-855d-8a2771fec9ae" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 827.567244] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6a25aaa-e879-47db-855d-8a2771fec9ae" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.567883] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6a25aaa-e879-47db-855d-8a2771fec9ae" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 827.567883] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6a25aaa-e879-47db-855d-8a2771fec9ae',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.072904] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6a25aaa-e879-47db-855d-8a2771fec9ae [ 828.076076] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.076076] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.076076] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.076076] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.076076] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.076076] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6a25aaa-e879-47db-855d-8a2771fec9ae already deleted. [ 828.076076] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6a25aaa-e879-47db-855d-8a2771fec9ae" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.307011] env[70879]: INFO networking_nsxv3.common.synchronization [None req-a99282a4-3939-446e-87e4-b111c82a3208 None None] Enqueued Resource ID: b60269a1-915e-41f8-b56b-836f210df033 with Priority: HIGHEST for action port [ 828.307231] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60269a1-915e-41f8-b56b-836f210df033 with Priority: HIGHEST for action port [ 828.307867] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-b60269a1-915e-41f8-b56b-836f210df033 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.308070] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b60269a1-915e-41f8-b56b-836f210df033" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.309038] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b60269a1-915e-41f8-b56b-836f210df033" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.309321] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b60269a1-915e-41f8-b56b-836f210df033" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.309434] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b60269a1-915e-41f8-b56b-836f210df033',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.490251] env[70879]: INFO networking_nsxv3.common.synchronization [None req-c810b47c-baf2-4f77-a532-dc53faca64fb tempest-ServersTestFqdnHostnames-2108504930 tempest-ServersTestFqdnHostnames-2108504930-project-member] Enqueued Resource ID: c61543d6-279d-4157-a0b1-20d533975ac0 with Priority: HIGHEST for action security_group_rules [ 828.490775] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c61543d6-279d-4157-a0b1-20d533975ac0 with Priority: HIGHEST for action security_group_rules [ 828.491102] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c61543d6-279d-4157-a0b1-20d533975ac0 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.491223] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c61543d6-279d-4157-a0b1-20d533975ac0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.491288] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c61543d6-279d-4157-a0b1-20d533975ac0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.491537] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c61543d6-279d-4157-a0b1-20d533975ac0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.491611] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c61543d6-279d-4157-a0b1-20d533975ac0',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.612102] env[70879]: INFO networking_nsxv3.common.synchronization [None req-f74fcc48-6ba0-4f13-b1fa-0dcefd80e102 None None] Enqueued Resource ID: 9099289f-34a0-4406-93d8-31ada75b9461 with Priority: HIGHEST for action port [ 828.612353] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9099289f-34a0-4406-93d8-31ada75b9461 with Priority: HIGHEST for action port [ 828.612891] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-9099289f-34a0-4406-93d8-31ada75b9461 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.612995] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9099289f-34a0-4406-93d8-31ada75b9461" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.613231] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9099289f-34a0-4406-93d8-31ada75b9461" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.613310] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9099289f-34a0-4406-93d8-31ada75b9461" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.613389] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9099289f-34a0-4406-93d8-31ada75b9461',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.712385] env[70879]: INFO networking_nsxv3.common.synchronization [None req-9836dbd1-81b9-4639-87f9-61cab6de321c tempest-ServersTestFqdnHostnames-2108504930 tempest-ServersTestFqdnHostnames-2108504930-project-member] Enqueued Resource ID: c61543d6-279d-4157-a0b1-20d533975ac0 with Priority: HIGHEST for action security_group_rules [ 828.712921] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c61543d6-279d-4157-a0b1-20d533975ac0 with Priority: HIGHEST for action security_group_rules [ 828.713459] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c61543d6-279d-4157-a0b1-20d533975ac0 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.713459] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c61543d6-279d-4157-a0b1-20d533975ac0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.814724] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b60269a1-915e-41f8-b56b-836f210df033 [ 828.814967] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.815115] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.815188] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.815409] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.815499] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.815594] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b60269a1-915e-41f8-b56b-836f210df033 already deleted. [ 828.815674] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b60269a1-915e-41f8-b56b-836f210df033" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 828.829516] env[70879]: INFO networking_nsxv3.common.synchronization [req-fcfb8668-bd1a-4728-8809-e45bde8d53d2 req-a1561544-6a9a-437f-8da0-73d46a98b1ec tempest-SecurityGroupRulesTestJSON-687639067 tempest-SecurityGroupRulesTestJSON-687639067-project-member] Enqueued Resource ID: 8614dc07-77e6-47ce-9d9f-9087a444a4e2 with Priority: HIGHEST for action security_group_rules [ 828.830069] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8614dc07-77e6-47ce-9d9f-9087a444a4e2 with Priority: HIGHEST for action security_group_rules [ 828.830365] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.830483] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 828.830550] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.830785] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 828.830848] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8614dc07-77e6-47ce-9d9f-9087a444a4e2',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.014637] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.014637] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.014637] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.014637] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.014637] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.014637] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c61543d6-279d-4157-a0b1-20d533975ac0 already deleted. [ 829.014637] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c61543d6-279d-4157-a0b1-20d533975ac0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.014987] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c61543d6-279d-4157-a0b1-20d533975ac0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.014987] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c61543d6-279d-4157-a0b1-20d533975ac0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.015076] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c61543d6-279d-4157-a0b1-20d533975ac0',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.117293] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9099289f-34a0-4406-93d8-31ada75b9461 [ 829.118751] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.118751] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.118751] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.118751] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.118751] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.118751] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9099289f-34a0-4406-93d8-31ada75b9461 already deleted. [ 829.118751] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9099289f-34a0-4406-93d8-31ada75b9461" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.358106] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.358250] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.358319] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.358539] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.358622] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.358712] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8614dc07-77e6-47ce-9d9f-9087a444a4e2 already deleted. [ 829.358816] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8614dc07-77e6-47ce-9d9f-9087a444a4e2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.540548] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.540548] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 829.540548] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.540548] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 829.540548] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 829.540886] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c61543d6-279d-4157-a0b1-20d533975ac0 already deleted. [ 829.540886] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c61543d6-279d-4157-a0b1-20d533975ac0" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.220107] env[70879]: INFO networking_nsxv3.common.synchronization [None req-57dc9da4-1077-4a44-b200-2ee51cdecb2f None None] Enqueued Resource ID: b4f9c90b-a437-4479-bb5f-87112cc57ec4 with Priority: HIGHEST for action port [ 830.220362] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4f9c90b-a437-4479-bb5f-87112cc57ec4 with Priority: HIGHEST for action port [ 830.220890] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4f9c90b-a437-4479-bb5f-87112cc57ec4 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.221014] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4f9c90b-a437-4479-bb5f-87112cc57ec4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.221092] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4f9c90b-a437-4479-bb5f-87112cc57ec4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.221352] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4f9c90b-a437-4479-bb5f-87112cc57ec4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.221431] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4f9c90b-a437-4479-bb5f-87112cc57ec4',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.528567] env[70879]: INFO networking_nsxv3.common.synchronization [None req-c121e665-a5d6-41f9-b06f-995b9df9f940 None None] Enqueued Resource ID: 632abf57-f6d8-4731-b5c9-9f431912f835 with Priority: HIGHEST for action port [ 830.529210] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 632abf57-f6d8-4731-b5c9-9f431912f835 with Priority: HIGHEST for action port [ 830.529592] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-632abf57-f6d8-4731-b5c9-9f431912f835 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.529759] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-632abf57-f6d8-4731-b5c9-9f431912f835" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.529816] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-632abf57-f6d8-4731-b5c9-9f431912f835" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.530666] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-632abf57-f6d8-4731-b5c9-9f431912f835" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.530751] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632abf57-f6d8-4731-b5c9-9f431912f835',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.728197] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4f9c90b-a437-4479-bb5f-87112cc57ec4 [ 830.728435] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.728570] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 830.728652] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.728886] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 830.728961] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 830.729073] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4f9c90b-a437-4479-bb5f-87112cc57ec4 already deleted. [ 830.729151] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4f9c90b-a437-4479-bb5f-87112cc57ec4" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.033445] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 632abf57-f6d8-4731-b5c9-9f431912f835 [ 831.033687] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.034739] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.034739] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.034739] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.036407] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.036559] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:632abf57-f6d8-4731-b5c9-9f431912f835 already deleted. [ 831.036687] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-632abf57-f6d8-4731-b5c9-9f431912f835" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 831.682937] env[70879]: INFO networking_nsxv3.common.synchronization [None req-29632148-ada0-440f-b8ad-e3a6110c02d7 tempest-ServerActionsTestOtherA-402713272 tempest-ServerActionsTestOtherA-402713272-project-member] Enqueued Resource ID: a968790b-5a09-4529-82b1-5f58a46bc343 with Priority: HIGHEST for action security_group_rules [ 831.683644] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a968790b-5a09-4529-82b1-5f58a46bc343 with Priority: HIGHEST for action security_group_rules [ 831.683774] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a968790b-5a09-4529-82b1-5f58a46bc343 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.683979] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a968790b-5a09-4529-82b1-5f58a46bc343" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 831.683979] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a968790b-5a09-4529-82b1-5f58a46bc343" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.684868] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a968790b-5a09-4529-82b1-5f58a46bc343" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 831.684985] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a968790b-5a09-4529-82b1-5f58a46bc343',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.974981] env[70879]: INFO networking_nsxv3.common.synchronization [None req-5b3881e1-0805-47ff-89cd-5fe6b098ab89 tempest-ServerActionsTestOtherA-402713272 tempest-ServerActionsTestOtherA-402713272-project-member] Enqueued Resource ID: a968790b-5a09-4529-82b1-5f58a46bc343 with Priority: HIGHEST for action security_group_rules [ 831.974981] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a968790b-5a09-4529-82b1-5f58a46bc343 with Priority: HIGHEST for action security_group_rules [ 831.976814] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a968790b-5a09-4529-82b1-5f58a46bc343 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.976814] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a968790b-5a09-4529-82b1-5f58a46bc343" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.228131] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.228869] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.228869] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.228869] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.229021] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.229052] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a968790b-5a09-4529-82b1-5f58a46bc343 already deleted. [ 832.230053] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a968790b-5a09-4529-82b1-5f58a46bc343" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.230053] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a968790b-5a09-4529-82b1-5f58a46bc343" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.230291] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a968790b-5a09-4529-82b1-5f58a46bc343" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.230291] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a968790b-5a09-4529-82b1-5f58a46bc343',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.295872] env[70879]: INFO networking_nsxv3.common.synchronization [None req-153a6cf3-ccb9-4044-a765-23d25312d09b None None] Enqueued Resource ID: 28286103-398a-457f-9022-1918526a6565 with Priority: HIGHEST for action port [ 832.295872] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28286103-398a-457f-9022-1918526a6565 with Priority: HIGHEST for action port [ 832.295872] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-28286103-398a-457f-9022-1918526a6565 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.295872] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28286103-398a-457f-9022-1918526a6565" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.295872] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28286103-398a-457f-9022-1918526a6565" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.295872] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28286103-398a-457f-9022-1918526a6565" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.295872] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28286103-398a-457f-9022-1918526a6565',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.754746] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.755034] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.755034] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.756140] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.756140] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.756140] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a968790b-5a09-4529-82b1-5f58a46bc343 already deleted. [ 832.756576] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a968790b-5a09-4529-82b1-5f58a46bc343" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.797822] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28286103-398a-457f-9022-1918526a6565 [ 832.798127] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.799829] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 832.799829] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.799829] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 832.799829] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 832.799829] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28286103-398a-457f-9022-1918526a6565 already deleted. [ 832.799829] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28286103-398a-457f-9022-1918526a6565" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 833.861718] env[70879]: INFO networking_nsxv3.common.synchronization [None req-abb11640-a2e2-4f72-925b-887d22ce267c None None] Enqueued Resource ID: 035af82e-3db8-453d-aaa3-8b179b3768cf with Priority: HIGHEST for action port [ 833.862966] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 035af82e-3db8-453d-aaa3-8b179b3768cf with Priority: HIGHEST for action port [ 833.864544] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-035af82e-3db8-453d-aaa3-8b179b3768cf taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.865243] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-035af82e-3db8-453d-aaa3-8b179b3768cf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.865243] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-035af82e-3db8-453d-aaa3-8b179b3768cf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.865520] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-035af82e-3db8-453d-aaa3-8b179b3768cf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.865635] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('035af82e-3db8-453d-aaa3-8b179b3768cf',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.945482] env[70879]: INFO networking_nsxv3.common.synchronization [None req-962b7ae1-965f-4c70-9033-97f1a62f7dc8 None None] Enqueued Resource ID: 339d8b54-8bee-425d-ab30-d685bc4a0126 with Priority: HIGHEST for action port [ 833.945734] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339d8b54-8bee-425d-ab30-d685bc4a0126 with Priority: HIGHEST for action port [ 833.946571] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-339d8b54-8bee-425d-ab30-d685bc4a0126 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.946958] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-339d8b54-8bee-425d-ab30-d685bc4a0126" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 833.946958] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-339d8b54-8bee-425d-ab30-d685bc4a0126" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.950929] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-339d8b54-8bee-425d-ab30-d685bc4a0126" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 833.951092] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('339d8b54-8bee-425d-ab30-d685bc4a0126',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.371159] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 035af82e-3db8-453d-aaa3-8b179b3768cf [ 834.371159] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.371159] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.371159] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.371388] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.371432] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.371532] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:035af82e-3db8-453d-aaa3-8b179b3768cf already deleted. [ 834.371612] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-035af82e-3db8-453d-aaa3-8b179b3768cf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.456743] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 339d8b54-8bee-425d-ab30-d685bc4a0126 [ 834.456978] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.457131] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 834.457199] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.457456] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 834.457552] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 834.457649] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:339d8b54-8bee-425d-ab30-d685bc4a0126 already deleted. [ 834.457735] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-339d8b54-8bee-425d-ab30-d685bc4a0126" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 835.860559] env[70879]: INFO networking_nsxv3.common.synchronization [None req-3bb778b8-e49f-42a1-a17f-2b5922bbd6e4 None None] Enqueued Resource ID: 1f398dd5-b0cd-4ab5-a579-feba0c9564f5 with Priority: HIGHEST for action port [ 835.860559] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f398dd5-b0cd-4ab5-a579-feba0c9564f5 with Priority: HIGHEST for action port [ 835.861673] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f398dd5-b0cd-4ab5-a579-feba0c9564f5 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.861790] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f398dd5-b0cd-4ab5-a579-feba0c9564f5" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 835.861854] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f398dd5-b0cd-4ab5-a579-feba0c9564f5" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.862759] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f398dd5-b0cd-4ab5-a579-feba0c9564f5" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 835.862759] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f398dd5-b0cd-4ab5-a579-feba0c9564f5',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.366172] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f398dd5-b0cd-4ab5-a579-feba0c9564f5 [ 836.366172] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.366172] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.366172] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.366172] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.366172] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.366172] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f398dd5-b0cd-4ab5-a579-feba0c9564f5 already deleted. [ 836.366172] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f398dd5-b0cd-4ab5-a579-feba0c9564f5" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 836.870576] env[70879]: INFO networking_nsxv3.common.synchronization [None req-9e512697-c148-463e-918d-ad74ea53c571 None None] Enqueued Resource ID: b4acc38d-6ab5-42ce-b801-fea3b9fd3db7 with Priority: HIGHEST for action port [ 836.871137] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4acc38d-6ab5-42ce-b801-fea3b9fd3db7 with Priority: HIGHEST for action port [ 836.871438] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4acc38d-6ab5-42ce-b801-fea3b9fd3db7 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.871850] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4acc38d-6ab5-42ce-b801-fea3b9fd3db7" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 836.871850] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4acc38d-6ab5-42ce-b801-fea3b9fd3db7" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.871937] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4acc38d-6ab5-42ce-b801-fea3b9fd3db7" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 836.871937] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4acc38d-6ab5-42ce-b801-fea3b9fd3db7',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.376502] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4acc38d-6ab5-42ce-b801-fea3b9fd3db7 [ 837.376502] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.376502] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 837.376502] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.378105] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 837.378105] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 837.378413] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4acc38d-6ab5-42ce-b801-fea3b9fd3db7 already deleted. [ 837.378678] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4acc38d-6ab5-42ce-b801-fea3b9fd3db7" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.408017] env[70879]: INFO networking_nsxv3.common.synchronization [None req-e840771d-f288-459f-bd2b-f2db8e73aa8b None None] Enqueued Resource ID: 97886697-db7f-4edc-825d-b6ae2fc4cffa with Priority: HIGHEST for action port [ 840.408325] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97886697-db7f-4edc-825d-b6ae2fc4cffa with Priority: HIGHEST for action port [ 840.408959] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-97886697-db7f-4edc-825d-b6ae2fc4cffa taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.410144] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97886697-db7f-4edc-825d-b6ae2fc4cffa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.410413] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97886697-db7f-4edc-825d-b6ae2fc4cffa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.412103] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97886697-db7f-4edc-825d-b6ae2fc4cffa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.412103] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97886697-db7f-4edc-825d-b6ae2fc4cffa',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.641308] env[70879]: INFO networking_nsxv3.common.synchronization [None req-9fffabcc-9a00-4b2f-bccf-32739fbdaadf None None] Enqueued Resource ID: a0c7de52-460f-4d2e-86d7-061c801b7c84 with Priority: HIGHEST for action port [ 840.641596] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0c7de52-460f-4d2e-86d7-061c801b7c84 with Priority: HIGHEST for action port [ 840.644129] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0c7de52-460f-4d2e-86d7-061c801b7c84 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.644129] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0c7de52-460f-4d2e-86d7-061c801b7c84" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.644129] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0c7de52-460f-4d2e-86d7-061c801b7c84" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.644129] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0c7de52-460f-4d2e-86d7-061c801b7c84" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.644129] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0c7de52-460f-4d2e-86d7-061c801b7c84',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.916665] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97886697-db7f-4edc-825d-b6ae2fc4cffa [ 840.916665] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.916665] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 840.919024] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.919024] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 840.919024] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 840.919024] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97886697-db7f-4edc-825d-b6ae2fc4cffa already deleted. [ 840.919024] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97886697-db7f-4edc-825d-b6ae2fc4cffa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.148965] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0c7de52-460f-4d2e-86d7-061c801b7c84 [ 841.148965] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.148965] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.148965] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.149123] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.149450] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.149450] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0c7de52-460f-4d2e-86d7-061c801b7c84 already deleted. [ 841.149450] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0c7de52-460f-4d2e-86d7-061c801b7c84" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 841.663838] env[70879]: INFO networking_nsxv3.common.synchronization [None req-58ba52ba-7145-454a-a714-7d04539148dc None None] Enqueued Resource ID: 3225c9e7-f751-47d1-8626-469d35812a30 with Priority: HIGHEST for action port [ 841.663838] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3225c9e7-f751-47d1-8626-469d35812a30 with Priority: HIGHEST for action port [ 841.663838] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-3225c9e7-f751-47d1-8626-469d35812a30 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.663838] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3225c9e7-f751-47d1-8626-469d35812a30" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 841.663838] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3225c9e7-f751-47d1-8626-469d35812a30" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.665034] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3225c9e7-f751-47d1-8626-469d35812a30" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 841.665034] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3225c9e7-f751-47d1-8626-469d35812a30',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.167299] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3225c9e7-f751-47d1-8626-469d35812a30 [ 842.167602] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.167717] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 842.167755] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.169647] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 842.169647] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 842.169647] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3225c9e7-f751-47d1-8626-469d35812a30 already deleted. [ 842.169647] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3225c9e7-f751-47d1-8626-469d35812a30" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 843.946209] env[70879]: INFO networking_nsxv3.common.synchronization [None req-7d8e712d-6d45-4355-b4f3-e45ec4b4b90c tempest-AttachInterfacesTestJSON-909183734 tempest-AttachInterfacesTestJSON-909183734-project-member] Enqueued Resource ID: 1b937798-9056-44ff-a9bd-238313160557 with Priority: HIGHEST for action security_group_rules [ 843.946681] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b937798-9056-44ff-a9bd-238313160557 with Priority: HIGHEST for action security_group_rules [ 843.948207] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b937798-9056-44ff-a9bd-238313160557 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.948422] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b937798-9056-44ff-a9bd-238313160557" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 843.948422] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b937798-9056-44ff-a9bd-238313160557" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.948682] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b937798-9056-44ff-a9bd-238313160557" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 843.948770] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b937798-9056-44ff-a9bd-238313160557',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.389249] env[70879]: INFO networking_nsxv3.common.synchronization [None req-ed0c6296-6f31-46de-ae0c-c64932fe3732 tempest-AttachInterfacesTestJSON-909183734 tempest-AttachInterfacesTestJSON-909183734-project-member] Enqueued Resource ID: 1b937798-9056-44ff-a9bd-238313160557 with Priority: HIGHEST for action security_group_rules [ 844.389856] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b937798-9056-44ff-a9bd-238313160557 with Priority: HIGHEST for action security_group_rules [ 844.390053] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b937798-9056-44ff-a9bd-238313160557 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.390151] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b937798-9056-44ff-a9bd-238313160557" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.472840] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.473416] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.473500] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.473726] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.473813] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.473921] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b937798-9056-44ff-a9bd-238313160557 already deleted. [ 844.474012] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b937798-9056-44ff-a9bd-238313160557" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.474169] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b937798-9056-44ff-a9bd-238313160557" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.474419] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b937798-9056-44ff-a9bd-238313160557" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.474419] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b937798-9056-44ff-a9bd-238313160557',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.996697] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.997066] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 844.997066] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.997158] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 844.997203] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 844.997299] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b937798-9056-44ff-a9bd-238313160557 already deleted. [ 844.997386] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b937798-9056-44ff-a9bd-238313160557" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.422264] env[70879]: INFO networking_nsxv3.common.synchronization [None req-31bd8ce9-7d56-4c03-b100-fac60b61790c None None] Enqueued Resource ID: ec276a2d-efb4-4b0a-82f1-f75e7048688c with Priority: HIGHEST for action port [ 845.422515] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec276a2d-efb4-4b0a-82f1-f75e7048688c with Priority: HIGHEST for action port [ 845.423618] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec276a2d-efb4-4b0a-82f1-f75e7048688c taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.423859] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec276a2d-efb4-4b0a-82f1-f75e7048688c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.423903] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec276a2d-efb4-4b0a-82f1-f75e7048688c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.424691] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec276a2d-efb4-4b0a-82f1-f75e7048688c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.424691] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec276a2d-efb4-4b0a-82f1-f75e7048688c',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.927473] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec276a2d-efb4-4b0a-82f1-f75e7048688c [ 845.927593] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.927714] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 845.927714] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.928042] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 845.928113] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 845.928189] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec276a2d-efb4-4b0a-82f1-f75e7048688c already deleted. [ 845.928800] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec276a2d-efb4-4b0a-82f1-f75e7048688c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.043237] env[70879]: INFO networking_nsxv3.common.synchronization [None req-0b34435a-1fc8-4e99-a236-37f670d16d03 None None] Enqueued Resource ID: f2ab25d7-7ac1-4a76-b621-2914a3ded99c with Priority: HIGHEST for action port [ 846.043666] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ab25d7-7ac1-4a76-b621-2914a3ded99c with Priority: HIGHEST for action port [ 846.043978] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2ab25d7-7ac1-4a76-b621-2914a3ded99c taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.044117] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2ab25d7-7ac1-4a76-b621-2914a3ded99c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.044180] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2ab25d7-7ac1-4a76-b621-2914a3ded99c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.044444] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2ab25d7-7ac1-4a76-b621-2914a3ded99c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.044524] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2ab25d7-7ac1-4a76-b621-2914a3ded99c',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.550258] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2ab25d7-7ac1-4a76-b621-2914a3ded99c [ 846.550552] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.550711] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 846.550777] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.551027] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 846.551130] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 846.551248] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2ab25d7-7ac1-4a76-b621-2914a3ded99c already deleted. [ 846.551320] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2ab25d7-7ac1-4a76-b621-2914a3ded99c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.070209] env[70879]: INFO networking_nsxv3.common.synchronization [None req-bc53bae6-8633-4ab3-af0b-d34b93fdebd2 None None] Enqueued Resource ID: d0cf2713-70cb-4fd2-82cf-53b4e4f463c1 with Priority: HIGHEST for action port [ 847.070209] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0cf2713-70cb-4fd2-82cf-53b4e4f463c1 with Priority: HIGHEST for action port [ 847.070209] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0cf2713-70cb-4fd2-82cf-53b4e4f463c1 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.070209] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0cf2713-70cb-4fd2-82cf-53b4e4f463c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.070209] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0cf2713-70cb-4fd2-82cf-53b4e4f463c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.070209] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0cf2713-70cb-4fd2-82cf-53b4e4f463c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.070209] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0cf2713-70cb-4fd2-82cf-53b4e4f463c1',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.511029] env[70879]: INFO networking_nsxv3.common.synchronization [None req-adfb7daf-b953-49bd-90df-9098f670fd4a None None] Enqueued Resource ID: bdf552a1-1fde-4ebc-bf03-e23403ea2c6f with Priority: HIGHEST for action port [ 847.512793] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf552a1-1fde-4ebc-bf03-e23403ea2c6f with Priority: HIGHEST for action port [ 847.513293] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdf552a1-1fde-4ebc-bf03-e23403ea2c6f taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.513447] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdf552a1-1fde-4ebc-bf03-e23403ea2c6f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.513539] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdf552a1-1fde-4ebc-bf03-e23403ea2c6f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.516506] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdf552a1-1fde-4ebc-bf03-e23403ea2c6f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.518115] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf552a1-1fde-4ebc-bf03-e23403ea2c6f',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.576864] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0cf2713-70cb-4fd2-82cf-53b4e4f463c1 [ 847.576864] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.576864] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.576864] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.576864] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.576864] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.576864] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0cf2713-70cb-4fd2-82cf-53b4e4f463c1 already deleted. [ 847.576864] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0cf2713-70cb-4fd2-82cf-53b4e4f463c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 847.659805] env[70879]: INFO networking_nsxv3.common.synchronization [None req-ae5e6d33-eae5-4869-b551-9e9ce32d5d3a None None] Enqueued Resource ID: abbd79d0-c4d7-4ffd-be7a-622b4a276bfa with Priority: HIGHEST for action port [ 847.659805] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abbd79d0-c4d7-4ffd-be7a-622b4a276bfa with Priority: HIGHEST for action port [ 847.659805] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-abbd79d0-c4d7-4ffd-be7a-622b4a276bfa taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.659805] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abbd79d0-c4d7-4ffd-be7a-622b4a276bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 847.659805] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abbd79d0-c4d7-4ffd-be7a-622b4a276bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.659805] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abbd79d0-c4d7-4ffd-be7a-622b4a276bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 847.659805] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abbd79d0-c4d7-4ffd-be7a-622b4a276bfa',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.018704] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdf552a1-1fde-4ebc-bf03-e23403ea2c6f [ 848.018943] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.019163] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.019283] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.019593] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.019703] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.019807] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdf552a1-1fde-4ebc-bf03-e23403ea2c6f already deleted. [ 848.019895] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdf552a1-1fde-4ebc-bf03-e23403ea2c6f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.163323] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abbd79d0-c4d7-4ffd-be7a-622b4a276bfa [ 848.163681] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.163777] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.163847] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.164119] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.164229] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.164325] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abbd79d0-c4d7-4ffd-be7a-622b4a276bfa already deleted. [ 848.164407] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abbd79d0-c4d7-4ffd-be7a-622b4a276bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 848.506601] env[70879]: INFO networking_nsxv3.common.synchronization [None req-15840d02-5e02-4b04-8b2f-d07b56278805 tempest-AttachVolumeNegativeTest-2106626094 tempest-AttachVolumeNegativeTest-2106626094-project-member] Enqueued Resource ID: 380f151a-ddce-4c9c-bfb1-1bcaded48f66 with Priority: HIGHEST for action security_group_rules [ 848.507185] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380f151a-ddce-4c9c-bfb1-1bcaded48f66 with Priority: HIGHEST for action security_group_rules [ 848.507504] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.507632] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 848.507699] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.512022] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 848.512022] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380f151a-ddce-4c9c-bfb1-1bcaded48f66',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.034167] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.035246] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.035358] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.035657] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.035765] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.036176] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380f151a-ddce-4c9c-bfb1-1bcaded48f66 already deleted. [ 849.036176] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.233942] env[70879]: INFO networking_nsxv3.common.synchronization [None req-8a9e80bb-67c3-4f83-ad94-80ce688355df tempest-AttachVolumeNegativeTest-2106626094 tempest-AttachVolumeNegativeTest-2106626094-project-member] Enqueued Resource ID: 380f151a-ddce-4c9c-bfb1-1bcaded48f66 with Priority: HIGHEST for action security_group_rules [ 849.238022] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380f151a-ddce-4c9c-bfb1-1bcaded48f66 with Priority: HIGHEST for action security_group_rules [ 849.238022] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.238022] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.238022] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.238022] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.238022] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380f151a-ddce-4c9c-bfb1-1bcaded48f66',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.765670] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.765872] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 849.765914] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.766131] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 849.766230] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 849.766329] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380f151a-ddce-4c9c-bfb1-1bcaded48f66 already deleted. [ 849.766413] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380f151a-ddce-4c9c-bfb1-1bcaded48f66" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 850.952610] env[70879]: INFO networking_nsxv3.common.synchronization [None req-0657a9ca-a53e-4430-bff2-4a3052f74d8d None None] Enqueued Resource ID: 169e1956-0d70-4a74-adef-a9b1e90bad69 with Priority: HIGHEST for action port [ 850.953607] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 169e1956-0d70-4a74-adef-a9b1e90bad69 with Priority: HIGHEST for action port [ 850.955869] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-169e1956-0d70-4a74-adef-a9b1e90bad69 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.955869] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-169e1956-0d70-4a74-adef-a9b1e90bad69" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 850.956039] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-169e1956-0d70-4a74-adef-a9b1e90bad69" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.956461] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-169e1956-0d70-4a74-adef-a9b1e90bad69" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 850.956624] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('169e1956-0d70-4a74-adef-a9b1e90bad69',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.135495] env[70879]: INFO networking_nsxv3.common.synchronization [None req-1fe9d56c-f4b3-43f5-8ad0-8f0c6d432be0 tempest-AttachVolumeTestJSON-493731082 tempest-AttachVolumeTestJSON-493731082-project-member] Enqueued Resource ID: 35c7c7c0-6a88-4296-9f98-7c835b8d8bfa with Priority: HIGHEST for action security_group_rules [ 851.136100] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35c7c7c0-6a88-4296-9f98-7c835b8d8bfa with Priority: HIGHEST for action security_group_rules [ 851.136340] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.136457] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.136527] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.136888] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.136888] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35c7c7c0-6a88-4296-9f98-7c835b8d8bfa',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.360591] env[70879]: INFO networking_nsxv3.common.synchronization [None req-f34c7da9-f8af-4726-a776-20088df12a04 tempest-AttachVolumeShelveTestJSON-1646129162 tempest-AttachVolumeShelveTestJSON-1646129162-project-member] Enqueued Resource ID: 4d66a875-e6b5-451a-ac74-3716cb507635 with Priority: HIGHEST for action security_group_rules [ 851.362181] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d66a875-e6b5-451a-ac74-3716cb507635 with Priority: HIGHEST for action security_group_rules [ 851.362515] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d66a875-e6b5-451a-ac74-3716cb507635 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.362644] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d66a875-e6b5-451a-ac74-3716cb507635" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.362731] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d66a875-e6b5-451a-ac74-3716cb507635" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.363791] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d66a875-e6b5-451a-ac74-3716cb507635" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.363924] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d66a875-e6b5-451a-ac74-3716cb507635',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.447909] env[70879]: INFO networking_nsxv3.common.synchronization [None req-b84055e3-7b53-4033-ab70-19e52c747caf None None] Enqueued Resource ID: 8645edab-348b-4277-bfc6-68ed79d14bd3 with Priority: HIGHEST for action port [ 851.447909] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8645edab-348b-4277-bfc6-68ed79d14bd3 with Priority: HIGHEST for action port [ 851.448510] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-8645edab-348b-4277-bfc6-68ed79d14bd3 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.448793] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8645edab-348b-4277-bfc6-68ed79d14bd3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.449198] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8645edab-348b-4277-bfc6-68ed79d14bd3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.450559] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8645edab-348b-4277-bfc6-68ed79d14bd3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.450559] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8645edab-348b-4277-bfc6-68ed79d14bd3',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.462608] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 169e1956-0d70-4a74-adef-a9b1e90bad69 [ 851.462791] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.463685] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.463685] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.463685] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.463685] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.463685] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:169e1956-0d70-4a74-adef-a9b1e90bad69 already deleted. [ 851.463685] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-169e1956-0d70-4a74-adef-a9b1e90bad69" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.568629] env[70879]: INFO networking_nsxv3.common.synchronization [None req-42f78047-5d26-4358-b1ca-5844bf6152c4 tempest-AttachVolumeTestJSON-493731082 tempest-AttachVolumeTestJSON-493731082-project-member] Enqueued Resource ID: 35c7c7c0-6a88-4296-9f98-7c835b8d8bfa with Priority: HIGHEST for action security_group_rules [ 851.568629] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35c7c7c0-6a88-4296-9f98-7c835b8d8bfa with Priority: HIGHEST for action security_group_rules [ 851.568629] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.568629] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.658148] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.659946] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.659946] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.659946] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.659946] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.659946] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35c7c7c0-6a88-4296-9f98-7c835b8d8bfa already deleted. [ 851.659946] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.659946] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.660244] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.660244] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35c7c7c0-6a88-4296-9f98-7c835b8d8bfa',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.712424] env[70879]: INFO networking_nsxv3.common.synchronization [None req-d2d17e5c-dbd8-4ad9-9384-a25e43de2558 tempest-AttachVolumeShelveTestJSON-1646129162 tempest-AttachVolumeShelveTestJSON-1646129162-project-member] Enqueued Resource ID: 4d66a875-e6b5-451a-ac74-3716cb507635 with Priority: HIGHEST for action security_group_rules [ 851.712879] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d66a875-e6b5-451a-ac74-3716cb507635 with Priority: HIGHEST for action security_group_rules [ 851.713194] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d66a875-e6b5-451a-ac74-3716cb507635 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.713304] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d66a875-e6b5-451a-ac74-3716cb507635" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.806421] env[70879]: INFO networking_nsxv3.common.synchronization [None req-f992c477-bb4b-4c29-8807-ecfaee8289ab None None] Enqueued Resource ID: a6f190be-a18c-491d-955f-b56962d6731b with Priority: HIGHEST for action port [ 851.806636] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f190be-a18c-491d-955f-b56962d6731b with Priority: HIGHEST for action port [ 851.807259] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6f190be-a18c-491d-955f-b56962d6731b taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.807431] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6f190be-a18c-491d-955f-b56962d6731b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.807491] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6f190be-a18c-491d-955f-b56962d6731b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.807733] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6f190be-a18c-491d-955f-b56962d6731b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.808499] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f190be-a18c-491d-955f-b56962d6731b',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.886242] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.886242] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.886242] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.886723] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.886723] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.886723] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d66a875-e6b5-451a-ac74-3716cb507635 already deleted. [ 851.886723] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d66a875-e6b5-451a-ac74-3716cb507635" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.887037] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d66a875-e6b5-451a-ac74-3716cb507635" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.887037] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d66a875-e6b5-451a-ac74-3716cb507635" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.887037] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d66a875-e6b5-451a-ac74-3716cb507635',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.953541] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8645edab-348b-4277-bfc6-68ed79d14bd3 [ 851.953541] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.953541] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 851.953541] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.953541] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 851.953541] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 851.953541] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8645edab-348b-4277-bfc6-68ed79d14bd3 already deleted. [ 851.953541] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8645edab-348b-4277-bfc6-68ed79d14bd3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.181501] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.181658] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 852.181744] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.181998] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 852.182161] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.182271] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35c7c7c0-6a88-4296-9f98-7c835b8d8bfa already deleted. [ 852.182441] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35c7c7c0-6a88-4296-9f98-7c835b8d8bfa" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.315400] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6f190be-a18c-491d-955f-b56962d6731b [ 852.315848] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.316061] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 852.316176] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.316475] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 852.316670] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.316839] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6f190be-a18c-491d-955f-b56962d6731b already deleted. [ 852.316929] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6f190be-a18c-491d-955f-b56962d6731b" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.409390] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.409552] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 852.409624] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.409842] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 852.409931] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 852.410040] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d66a875-e6b5-451a-ac74-3716cb507635 already deleted. [ 852.410126] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d66a875-e6b5-451a-ac74-3716cb507635" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 854.809825] env[70879]: INFO networking_nsxv3.common.synchronization [None req-e80dcc2d-068a-4601-9170-dbc19c48bd4e None None] Enqueued Resource ID: 3a05794e-2caa-4ed5-a46c-844908025b8f with Priority: HIGHEST for action port [ 854.810553] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a05794e-2caa-4ed5-a46c-844908025b8f with Priority: HIGHEST for action port [ 854.811508] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a05794e-2caa-4ed5-a46c-844908025b8f taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.811659] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a05794e-2caa-4ed5-a46c-844908025b8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 854.811714] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a05794e-2caa-4ed5-a46c-844908025b8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.812162] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a05794e-2caa-4ed5-a46c-844908025b8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 854.812355] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a05794e-2caa-4ed5-a46c-844908025b8f',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.315619] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a05794e-2caa-4ed5-a46c-844908025b8f [ 855.315862] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.315999] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 855.316076] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.316301] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 855.316634] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 855.316634] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a05794e-2caa-4ed5-a46c-844908025b8f already deleted. [ 855.316634] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a05794e-2caa-4ed5-a46c-844908025b8f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.286631] env[70879]: INFO networking_nsxv3.common.synchronization [None req-8b93046e-5d07-4df7-8244-db69e7da76b3 None None] Enqueued Resource ID: 55721994-1fcb-4827-8657-b96d0a3ef9cc with Priority: HIGHEST for action port [ 857.287194] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55721994-1fcb-4827-8657-b96d0a3ef9cc with Priority: HIGHEST for action port [ 857.287469] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-55721994-1fcb-4827-8657-b96d0a3ef9cc taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.287587] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55721994-1fcb-4827-8657-b96d0a3ef9cc" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.287653] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55721994-1fcb-4827-8657-b96d0a3ef9cc" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.287910] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55721994-1fcb-4827-8657-b96d0a3ef9cc" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.289103] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55721994-1fcb-4827-8657-b96d0a3ef9cc',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.793291] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55721994-1fcb-4827-8657-b96d0a3ef9cc [ 857.793521] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.793649] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.793716] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.793927] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.794038] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.794135] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55721994-1fcb-4827-8657-b96d0a3ef9cc already deleted. [ 857.794212] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55721994-1fcb-4827-8657-b96d0a3ef9cc" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 857.804391] env[70879]: INFO networking_nsxv3.common.synchronization [None req-8441e8ce-a401-46e0-a43c-dfc643ae7f5e None None] Enqueued Resource ID: 724b80dc-2da0-4382-a836-bb909b3d3d52 with Priority: HIGHEST for action port [ 857.804632] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724b80dc-2da0-4382-a836-bb909b3d3d52 with Priority: HIGHEST for action port [ 857.805890] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-724b80dc-2da0-4382-a836-bb909b3d3d52 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.805890] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-724b80dc-2da0-4382-a836-bb909b3d3d52" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 857.805890] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-724b80dc-2da0-4382-a836-bb909b3d3d52" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.805890] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-724b80dc-2da0-4382-a836-bb909b3d3d52" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 857.806048] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('724b80dc-2da0-4382-a836-bb909b3d3d52',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.310523] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 724b80dc-2da0-4382-a836-bb909b3d3d52 [ 858.312117] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.312117] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 858.312117] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.312117] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 858.312117] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 858.312117] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:724b80dc-2da0-4382-a836-bb909b3d3d52 already deleted. [ 858.312117] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-724b80dc-2da0-4382-a836-bb909b3d3d52" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 859.807176] env[70879]: INFO networking_nsxv3.common.synchronization [None req-83c13ebe-1fd5-4d9f-95bb-5e5a0af6a679 None None] Enqueued Resource ID: 43b9ee97-6825-4df9-851e-20486b439ddc with Priority: HIGHEST for action port [ 859.807872] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43b9ee97-6825-4df9-851e-20486b439ddc with Priority: HIGHEST for action port [ 859.808275] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-43b9ee97-6825-4df9-851e-20486b439ddc taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.808492] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43b9ee97-6825-4df9-851e-20486b439ddc" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.808588] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43b9ee97-6825-4df9-851e-20486b439ddc" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.808876] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43b9ee97-6825-4df9-851e-20486b439ddc" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.809261] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43b9ee97-6825-4df9-851e-20486b439ddc',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.960346] env[70879]: INFO networking_nsxv3.common.synchronization [None req-471029cb-2fe2-4634-abdc-bc48536e8973 None None] Enqueued Resource ID: ebb2e231-e495-43cf-a40c-bbbdb85ebc65 with Priority: HIGHEST for action port [ 859.960346] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb2e231-e495-43cf-a40c-bbbdb85ebc65 with Priority: HIGHEST for action port [ 859.960618] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebb2e231-e495-43cf-a40c-bbbdb85ebc65 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.960739] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebb2e231-e495-43cf-a40c-bbbdb85ebc65" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 859.960801] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebb2e231-e495-43cf-a40c-bbbdb85ebc65" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.962313] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebb2e231-e495-43cf-a40c-bbbdb85ebc65" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 859.962313] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebb2e231-e495-43cf-a40c-bbbdb85ebc65',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.312331] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43b9ee97-6825-4df9-851e-20486b439ddc [ 860.312583] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.312772] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.312883] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.313128] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.313230] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.313342] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43b9ee97-6825-4df9-851e-20486b439ddc already deleted. [ 860.313495] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43b9ee97-6825-4df9-851e-20486b439ddc" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.466140] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebb2e231-e495-43cf-a40c-bbbdb85ebc65 [ 860.466140] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.466140] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 860.466140] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.466140] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 860.466140] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 860.466140] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebb2e231-e495-43cf-a40c-bbbdb85ebc65 already deleted. [ 860.466140] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebb2e231-e495-43cf-a40c-bbbdb85ebc65" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.096652] env[70879]: INFO networking_nsxv3.common.synchronization [None req-b1466d2e-f5bc-4219-bbd8-94b1dd2f5c3a None None] Enqueued Resource ID: b5194cba-a1aa-46dc-a3a1-749f13c72bbf with Priority: HIGHEST for action port [ 861.096869] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5194cba-a1aa-46dc-a3a1-749f13c72bbf with Priority: HIGHEST for action port [ 861.097183] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5194cba-a1aa-46dc-a3a1-749f13c72bbf taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.097366] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5194cba-a1aa-46dc-a3a1-749f13c72bbf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.097485] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5194cba-a1aa-46dc-a3a1-749f13c72bbf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.099769] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5194cba-a1aa-46dc-a3a1-749f13c72bbf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.099769] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5194cba-a1aa-46dc-a3a1-749f13c72bbf',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.601951] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5194cba-a1aa-46dc-a3a1-749f13c72bbf [ 861.601951] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.601951] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 861.601951] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.602232] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 861.602232] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 861.602314] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5194cba-a1aa-46dc-a3a1-749f13c72bbf already deleted. [ 861.602347] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5194cba-a1aa-46dc-a3a1-749f13c72bbf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.111533] env[70879]: INFO networking_nsxv3.common.synchronization [None req-401df7a4-e4b8-4e80-acf1-bd0050cf9ad7 tempest-ServersV294TestFqdnHostnames-1488849378 tempest-ServersV294TestFqdnHostnames-1488849378-project-member] Enqueued Resource ID: c0dfb319-f676-4f71-b22f-ab7336c864a3 with Priority: HIGHEST for action security_group_rules [ 862.112096] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0dfb319-f676-4f71-b22f-ab7336c864a3 with Priority: HIGHEST for action security_group_rules [ 862.112415] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0dfb319-f676-4f71-b22f-ab7336c864a3 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.112634] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0dfb319-f676-4f71-b22f-ab7336c864a3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.112677] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0dfb319-f676-4f71-b22f-ab7336c864a3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.112889] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0dfb319-f676-4f71-b22f-ab7336c864a3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.112969] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0dfb319-f676-4f71-b22f-ab7336c864a3',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.209714] env[70879]: INFO networking_nsxv3.common.synchronization [None req-cebae754-7fa3-4d00-a87b-c24481c6a59b tempest-ServersV294TestFqdnHostnames-1488849378 tempest-ServersV294TestFqdnHostnames-1488849378-project-member] Enqueued Resource ID: c0dfb319-f676-4f71-b22f-ab7336c864a3 with Priority: HIGHEST for action security_group_rules [ 862.210351] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0dfb319-f676-4f71-b22f-ab7336c864a3 with Priority: HIGHEST for action security_group_rules [ 862.210710] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0dfb319-f676-4f71-b22f-ab7336c864a3 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.210821] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0dfb319-f676-4f71-b22f-ab7336c864a3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.217569] env[70879]: INFO networking_nsxv3.common.synchronization [None req-101a6173-a998-4108-8be5-6086b1d60b54 tempest-AttachInterfacesTestJSON-909183734 tempest-AttachInterfacesTestJSON-909183734-project-member] Enqueued Resource ID: 594fa0bb-cf64-44c7-a858-b9be12670ece with Priority: HIGHEST for action security_group_rules [ 862.217816] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 594fa0bb-cf64-44c7-a858-b9be12670ece with Priority: HIGHEST for action security_group_rules [ 862.218507] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-594fa0bb-cf64-44c7-a858-b9be12670ece taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.218670] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-594fa0bb-cf64-44c7-a858-b9be12670ece" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.218670] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-594fa0bb-cf64-44c7-a858-b9be12670ece" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.219483] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-594fa0bb-cf64-44c7-a858-b9be12670ece" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.219580] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('594fa0bb-cf64-44c7-a858-b9be12670ece',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.614760] env[70879]: INFO networking_nsxv3.common.synchronization [None req-9c2b8e27-4516-4621-8e91-9dced289edb4 tempest-AttachInterfacesTestJSON-909183734 tempest-AttachInterfacesTestJSON-909183734-project-member] Enqueued Resource ID: 594fa0bb-cf64-44c7-a858-b9be12670ece with Priority: HIGHEST for action security_group_rules [ 862.614760] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 594fa0bb-cf64-44c7-a858-b9be12670ece with Priority: HIGHEST for action security_group_rules [ 862.614760] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-594fa0bb-cf64-44c7-a858-b9be12670ece taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.614760] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-594fa0bb-cf64-44c7-a858-b9be12670ece" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.656584] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.656584] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.656584] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.656768] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.656848] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.656975] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0dfb319-f676-4f71-b22f-ab7336c864a3 already deleted. [ 862.657080] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0dfb319-f676-4f71-b22f-ab7336c864a3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.657404] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0dfb319-f676-4f71-b22f-ab7336c864a3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.657489] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0dfb319-f676-4f71-b22f-ab7336c864a3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.657549] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0dfb319-f676-4f71-b22f-ab7336c864a3',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.757019] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.757019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 862.757019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.757019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.757019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.757019] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 594fa0bb-cf64-44c7-a858-b9be12670ece already deleted. [ 862.757019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-594fa0bb-cf64-44c7-a858-b9be12670ece" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 862.757019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-594fa0bb-cf64-44c7-a858-b9be12670ece" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.757019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-594fa0bb-cf64-44c7-a858-b9be12670ece" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 862.757019] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('594fa0bb-cf64-44c7-a858-b9be12670ece',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.183438] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.184197] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.184197] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.184197] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.184197] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.184197] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0dfb319-f676-4f71-b22f-ab7336c864a3 already deleted. [ 863.184197] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0dfb319-f676-4f71-b22f-ab7336c864a3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.286085] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.286245] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.286312] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.286544] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.286641] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.286719] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 594fa0bb-cf64-44c7-a858-b9be12670ece already deleted. [ 863.286968] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-594fa0bb-cf64-44c7-a858-b9be12670ece" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 863.662453] env[70879]: INFO networking_nsxv3.common.synchronization [None req-5eeaa928-918d-4b10-a73a-305906b257ee tempest-AttachVolumeNegativeTest-2106626094 tempest-AttachVolumeNegativeTest-2106626094-project-member] Enqueued Resource ID: edb77767-8386-4c0b-aaf5-8a8f8a399e05 with Priority: HIGHEST for action security_group_rules [ 863.664508] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb77767-8386-4c0b-aaf5-8a8f8a399e05 with Priority: HIGHEST for action security_group_rules [ 863.665043] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.665043] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 863.665185] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.665523] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 863.665595] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edb77767-8386-4c0b-aaf5-8a8f8a399e05',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.821982] env[70879]: INFO networking_nsxv3.common.synchronization [None req-6ba5216e-7e7c-4143-8401-dcd1b8fd8461 tempest-AttachVolumeNegativeTest-2106626094 tempest-AttachVolumeNegativeTest-2106626094-project-member] Enqueued Resource ID: edb77767-8386-4c0b-aaf5-8a8f8a399e05 with Priority: HIGHEST for action security_group_rules [ 863.822538] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb77767-8386-4c0b-aaf5-8a8f8a399e05 with Priority: HIGHEST for action security_group_rules [ 863.822871] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.823011] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.195238] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.195785] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.195785] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.196381] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.196381] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.196381] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edb77767-8386-4c0b-aaf5-8a8f8a399e05 already deleted. [ 864.196381] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.196752] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.196978] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.197676] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edb77767-8386-4c0b-aaf5-8a8f8a399e05',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.539809] env[70879]: INFO networking_nsxv3.common.synchronization [None req-e6fffe39-5a5f-4e5f-b060-9573c7949791 tempest-AttachVolumeShelveTestJSON-1646129162 tempest-AttachVolumeShelveTestJSON-1646129162-project-member] Enqueued Resource ID: aea0e8d8-c539-4a6a-aa25-815cdeeea19c with Priority: HIGHEST for action security_group_rules [ 864.540356] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea0e8d8-c539-4a6a-aa25-815cdeeea19c with Priority: HIGHEST for action security_group_rules [ 864.540657] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.540857] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.540857] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.545313] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.545411] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aea0e8d8-c539-4a6a-aa25-815cdeeea19c',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.658214] env[70879]: INFO networking_nsxv3.common.synchronization [None req-435367c6-711f-4fb5-9833-ffc47d05d27b tempest-AttachVolumeShelveTestJSON-1646129162 tempest-AttachVolumeShelveTestJSON-1646129162-project-member] Enqueued Resource ID: aea0e8d8-c539-4a6a-aa25-815cdeeea19c with Priority: HIGHEST for action security_group_rules [ 864.658214] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea0e8d8-c539-4a6a-aa25-815cdeeea19c with Priority: HIGHEST for action security_group_rules [ 864.658214] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.658214] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.719873] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.720962] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.720962] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.720962] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.720962] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.720962] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edb77767-8386-4c0b-aaf5-8a8f8a399e05 already deleted. [ 864.720962] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edb77767-8386-4c0b-aaf5-8a8f8a399e05" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 864.798421] env[70879]: INFO networking_nsxv3.common.synchronization [None req-f7f21ef1-8b02-4eea-bf56-e849eb9ae299 tempest-AttachVolumeTestJSON-493731082 tempest-AttachVolumeTestJSON-493731082-project-member] Enqueued Resource ID: 3220864f-953d-44cc-b7e7-c6e05eeec2c1 with Priority: HIGHEST for action security_group_rules [ 864.799310] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3220864f-953d-44cc-b7e7-c6e05eeec2c1 with Priority: HIGHEST for action security_group_rules [ 864.799750] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.800013] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 864.800267] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.801780] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 864.801780] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3220864f-953d-44cc-b7e7-c6e05eeec2c1',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.991967] env[70879]: INFO networking_nsxv3.common.synchronization [None req-e6523edb-d850-44be-a4c7-048bff5cec33 tempest-AttachVolumeTestJSON-493731082 tempest-AttachVolumeTestJSON-493731082-project-member] Enqueued Resource ID: 3220864f-953d-44cc-b7e7-c6e05eeec2c1 with Priority: HIGHEST for action security_group_rules [ 864.992886] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3220864f-953d-44cc-b7e7-c6e05eeec2c1 with Priority: HIGHEST for action security_group_rules [ 864.992886] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.993051] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.068183] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.068349] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.068451] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.068668] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.068742] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.068866] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aea0e8d8-c539-4a6a-aa25-815cdeeea19c already deleted. [ 865.068920] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.069257] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.069257] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.069397] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aea0e8d8-c539-4a6a-aa25-815cdeeea19c',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.327409] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.327766] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.327766] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.328123] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.328235] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.328341] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3220864f-953d-44cc-b7e7-c6e05eeec2c1 already deleted. [ 865.328424] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.328579] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.328743] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.328828] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3220864f-953d-44cc-b7e7-c6e05eeec2c1',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.594669] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.594669] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.594669] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.594669] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.594669] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.594669] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aea0e8d8-c539-4a6a-aa25-815cdeeea19c already deleted. [ 865.594669] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aea0e8d8-c539-4a6a-aa25-815cdeeea19c" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.852566] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.854315] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 865.854315] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.854315] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 865.854315] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 865.854315] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3220864f-953d-44cc-b7e7-c6e05eeec2c1 already deleted. [ 865.854315] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3220864f-953d-44cc-b7e7-c6e05eeec2c1" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.153028] env[70879]: INFO networking_nsxv3.common.synchronization [None req-b208e878-431c-42f6-a2a2-39d79611aadb None None] Enqueued Resource ID: 3811f673-da4d-42f3-b96e-1712899c9c96 with Priority: HIGHEST for action port [ 868.153028] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3811f673-da4d-42f3-b96e-1712899c9c96 with Priority: HIGHEST for action port [ 868.154360] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-3811f673-da4d-42f3-b96e-1712899c9c96 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.154360] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3811f673-da4d-42f3-b96e-1712899c9c96" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.154360] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3811f673-da4d-42f3-b96e-1712899c9c96" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.154360] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3811f673-da4d-42f3-b96e-1712899c9c96" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.154360] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3811f673-da4d-42f3-b96e-1712899c9c96',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.657653] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3811f673-da4d-42f3-b96e-1712899c9c96 [ 868.657749] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.658544] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 868.658544] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.658544] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 868.658544] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 868.658544] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3811f673-da4d-42f3-b96e-1712899c9c96 already deleted. [ 868.658544] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3811f673-da4d-42f3-b96e-1712899c9c96" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 870.851574] env[70879]: INFO networking_nsxv3.common.synchronization [None req-91d1bc55-7122-483f-8780-25459c4c4f94 None None] Enqueued Resource ID: 6f744e18-4074-4fd6-b7d3-71dce2766f0d with Priority: HIGHEST for action port [ 870.853106] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f744e18-4074-4fd6-b7d3-71dce2766f0d with Priority: HIGHEST for action port [ 870.853424] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f744e18-4074-4fd6-b7d3-71dce2766f0d taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.854615] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f744e18-4074-4fd6-b7d3-71dce2766f0d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 870.854615] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f744e18-4074-4fd6-b7d3-71dce2766f0d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.854810] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f744e18-4074-4fd6-b7d3-71dce2766f0d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 870.854895] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f744e18-4074-4fd6-b7d3-71dce2766f0d',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.361194] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f744e18-4074-4fd6-b7d3-71dce2766f0d [ 871.362118] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.363251] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 871.363251] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.363251] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 871.363251] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 871.363251] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f744e18-4074-4fd6-b7d3-71dce2766f0d already deleted. [ 871.363251] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f744e18-4074-4fd6-b7d3-71dce2766f0d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.103251] env[70879]: INFO networking_nsxv3.common.synchronization [None req-b847e760-0084-4e81-8a58-b7071f1defd7 None None] Enqueued Resource ID: 6b48c34c-3338-4208-8413-e795838faaa3 with Priority: HIGHEST for action port [ 875.103684] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b48c34c-3338-4208-8413-e795838faaa3 with Priority: HIGHEST for action port [ 875.104567] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b48c34c-3338-4208-8413-e795838faaa3 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.104698] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b48c34c-3338-4208-8413-e795838faaa3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.104777] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b48c34c-3338-4208-8413-e795838faaa3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.105201] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b48c34c-3338-4208-8413-e795838faaa3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.105314] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b48c34c-3338-4208-8413-e795838faaa3',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.610328] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b48c34c-3338-4208-8413-e795838faaa3 [ 875.610328] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.610328] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 875.610328] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.610328] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 875.610328] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 875.610328] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b48c34c-3338-4208-8413-e795838faaa3 already deleted. [ 875.610328] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b48c34c-3338-4208-8413-e795838faaa3" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 877.517255] env[70879]: INFO networking_nsxv3.common.synchronization [None req-e8415d64-acbf-43cb-b8e3-63cb9ac45ae2 None None] Enqueued Resource ID: 18a518dd-7552-40b4-a2d5-cbafc5c5361d with Priority: HIGHEST for action port [ 877.517255] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18a518dd-7552-40b4-a2d5-cbafc5c5361d with Priority: HIGHEST for action port [ 877.517255] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-18a518dd-7552-40b4-a2d5-cbafc5c5361d taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.518551] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18a518dd-7552-40b4-a2d5-cbafc5c5361d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 877.518591] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18a518dd-7552-40b4-a2d5-cbafc5c5361d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.518918] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18a518dd-7552-40b4-a2d5-cbafc5c5361d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 877.519034] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18a518dd-7552-40b4-a2d5-cbafc5c5361d',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.022446] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18a518dd-7552-40b4-a2d5-cbafc5c5361d [ 878.022761] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.022761] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.022880] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.023715] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.023715] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.023715] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18a518dd-7552-40b4-a2d5-cbafc5c5361d already deleted. [ 878.023715] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18a518dd-7552-40b4-a2d5-cbafc5c5361d" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.249205] env[70879]: INFO networking_nsxv3.common.synchronization [None req-21e33c9d-30b8-4336-9a6e-0632b8d44323 None None] Enqueued Resource ID: 945f6fbc-93c5-4539-a9e7-52d6b50b7538 with Priority: HIGHEST for action port [ 878.249907] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 945f6fbc-93c5-4539-a9e7-52d6b50b7538 with Priority: HIGHEST for action port [ 878.250353] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-945f6fbc-93c5-4539-a9e7-52d6b50b7538 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.250607] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-945f6fbc-93c5-4539-a9e7-52d6b50b7538" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.250712] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-945f6fbc-93c5-4539-a9e7-52d6b50b7538" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.251112] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-945f6fbc-93c5-4539-a9e7-52d6b50b7538" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.251255] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('945f6fbc-93c5-4539-a9e7-52d6b50b7538',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.753804] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 945f6fbc-93c5-4539-a9e7-52d6b50b7538 [ 878.754400] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.754400] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 878.754400] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.754554] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 878.754554] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 878.754987] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:945f6fbc-93c5-4539-a9e7-52d6b50b7538 already deleted. [ 878.754987] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-945f6fbc-93c5-4539-a9e7-52d6b50b7538" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 879.693995] env[70879]: INFO networking_nsxv3.common.synchronization [None req-60519c74-a32e-4483-aa5d-059da9a06742 tempest-ServerActionsTestOtherB-1275959718 tempest-ServerActionsTestOtherB-1275959718-project-member] Enqueued Resource ID: 29466ce0-a9bb-4455-bce1-7d58d1e70f73 with Priority: HIGHEST for action security_group_rules [ 879.694584] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29466ce0-a9bb-4455-bce1-7d58d1e70f73 with Priority: HIGHEST for action security_group_rules [ 879.695250] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.695374] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.695452] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.695720] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.696013] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29466ce0-a9bb-4455-bce1-7d58d1e70f73',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.964547] env[70879]: INFO networking_nsxv3.common.synchronization [None req-21a208b8-18e2-4022-923d-655d4362b8b7 None None] Enqueued Resource ID: 2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72 with Priority: HIGHEST for action port [ 879.964547] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72 with Priority: HIGHEST for action port [ 879.964547] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.965919] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 879.966839] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.967052] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 879.967139] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.228037] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.228037] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.228037] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.228037] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.228037] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.228037] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29466ce0-a9bb-4455-bce1-7d58d1e70f73 already deleted. [ 880.228037] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.372839] env[70879]: INFO networking_nsxv3.common.synchronization [None req-81ce4c4c-86cf-48c7-bfbe-a02ff3366cfe tempest-ServerActionsTestOtherB-1275959718 tempest-ServerActionsTestOtherB-1275959718-project-member] Enqueued Resource ID: 29466ce0-a9bb-4455-bce1-7d58d1e70f73 with Priority: HIGHEST for action security_group_rules [ 880.373355] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29466ce0-a9bb-4455-bce1-7d58d1e70f73 with Priority: HIGHEST for action security_group_rules [ 880.373655] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.373794] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.373863] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.374083] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.374282] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29466ce0-a9bb-4455-bce1-7d58d1e70f73',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.473020] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72 [ 880.473020] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.473020] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.473020] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.473020] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.473020] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.473020] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72 already deleted. [ 880.473020] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e6b6fb1-b4a9-4e43-b75f-0ace945c9c72" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.901569] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.901834] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 880.901834] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.901999] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 880.902149] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 880.902445] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29466ce0-a9bb-4455-bce1-7d58d1e70f73 already deleted. [ 880.902445] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29466ce0-a9bb-4455-bce1-7d58d1e70f73" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.470139] env[70879]: INFO networking_nsxv3.common.synchronization [None req-28ced936-8977-4ee0-a57c-4888f1f5c5b1 None None] Enqueued Resource ID: 3a5cce20-e2ee-4c43-a969-e3eeb7eddd12 with Priority: HIGHEST for action port [ 881.470139] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a5cce20-e2ee-4c43-a969-e3eeb7eddd12 with Priority: HIGHEST for action port [ 881.470139] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a5cce20-e2ee-4c43-a969-e3eeb7eddd12 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.470622] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a5cce20-e2ee-4c43-a969-e3eeb7eddd12" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.470622] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a5cce20-e2ee-4c43-a969-e3eeb7eddd12" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.470710] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a5cce20-e2ee-4c43-a969-e3eeb7eddd12" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.470793] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a5cce20-e2ee-4c43-a969-e3eeb7eddd12',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.973343] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a5cce20-e2ee-4c43-a969-e3eeb7eddd12 [ 881.976693] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.976693] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 881.976693] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.976693] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 881.976693] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 881.976693] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a5cce20-e2ee-4c43-a969-e3eeb7eddd12 already deleted. [ 881.976693] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a5cce20-e2ee-4c43-a969-e3eeb7eddd12" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.202345] env[70879]: INFO networking_nsxv3.common.synchronization [None req-adeeec3f-aa59-4974-9a5f-977779a6dc6d None None] Enqueued Resource ID: 0cad4289-d587-40aa-8874-03da2870de02 with Priority: HIGHEST for action port [ 882.202345] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cad4289-d587-40aa-8874-03da2870de02 with Priority: HIGHEST for action port [ 882.202345] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cad4289-d587-40aa-8874-03da2870de02 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.202345] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cad4289-d587-40aa-8874-03da2870de02" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.202802] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cad4289-d587-40aa-8874-03da2870de02" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.202802] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cad4289-d587-40aa-8874-03da2870de02" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.202802] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cad4289-d587-40aa-8874-03da2870de02',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.705924] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cad4289-d587-40aa-8874-03da2870de02 [ 882.706319] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.706439] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 882.706439] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.706655] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 882.706741] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 882.706832] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cad4289-d587-40aa-8874-03da2870de02 already deleted. [ 882.706912] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cad4289-d587-40aa-8874-03da2870de02" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.129589] env[70879]: INFO networking_nsxv3.common.synchronization [None req-1f66bef1-5d54-4ec1-8a1d-3adaff396e8d None None] Enqueued Resource ID: 5244600b-4dc6-43bd-91f0-40f2a293f423 with Priority: HIGHEST for action port [ 883.130360] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5244600b-4dc6-43bd-91f0-40f2a293f423 with Priority: HIGHEST for action port [ 883.130360] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-5244600b-4dc6-43bd-91f0-40f2a293f423 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.130517] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5244600b-4dc6-43bd-91f0-40f2a293f423" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.130553] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5244600b-4dc6-43bd-91f0-40f2a293f423" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.133356] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5244600b-4dc6-43bd-91f0-40f2a293f423" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.133356] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5244600b-4dc6-43bd-91f0-40f2a293f423',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.288364] env[70879]: INFO networking_nsxv3.common.synchronization [None req-51e971ce-676a-4216-afbb-26c3ec88bcb6 None None] Enqueued Resource ID: f519ad49-9922-4eef-90e3-57f7a8f7fa71 with Priority: HIGHEST for action port [ 883.288910] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f519ad49-9922-4eef-90e3-57f7a8f7fa71 with Priority: HIGHEST for action port [ 883.291121] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-f519ad49-9922-4eef-90e3-57f7a8f7fa71 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.291121] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f519ad49-9922-4eef-90e3-57f7a8f7fa71" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.291121] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f519ad49-9922-4eef-90e3-57f7a8f7fa71" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.291121] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f519ad49-9922-4eef-90e3-57f7a8f7fa71" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.291121] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f519ad49-9922-4eef-90e3-57f7a8f7fa71',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.583990] env[70879]: INFO networking_nsxv3.common.synchronization [None req-6ca704d1-d84f-4671-b95c-ef6b1abd959a tempest-AttachInterfacesUnderV243Test-1317919877 tempest-AttachInterfacesUnderV243Test-1317919877-project-member] Enqueued Resource ID: 794731d2-b850-4b68-8e84-3ce1ca4aeecf with Priority: HIGHEST for action security_group_rules [ 883.584530] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794731d2-b850-4b68-8e84-3ce1ca4aeecf with Priority: HIGHEST for action security_group_rules [ 883.584832] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.584955] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.586183] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.586494] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.586588] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('794731d2-b850-4b68-8e84-3ce1ca4aeecf',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.635335] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5244600b-4dc6-43bd-91f0-40f2a293f423 [ 883.635581] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.635684] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.635763] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.636110] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.636383] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.637867] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5244600b-4dc6-43bd-91f0-40f2a293f423 already deleted. [ 883.637867] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5244600b-4dc6-43bd-91f0-40f2a293f423" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.700604] env[70879]: INFO networking_nsxv3.common.synchronization [None req-b22d8ff0-09ba-445c-ab68-ad2047807677 tempest-AttachInterfacesUnderV243Test-1317919877 tempest-AttachInterfacesUnderV243Test-1317919877-project-member] Enqueued Resource ID: 794731d2-b850-4b68-8e84-3ce1ca4aeecf with Priority: HIGHEST for action security_group_rules [ 883.701135] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794731d2-b850-4b68-8e84-3ce1ca4aeecf with Priority: HIGHEST for action security_group_rules [ 883.702133] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.702133] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.793964] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f519ad49-9922-4eef-90e3-57f7a8f7fa71 [ 883.793964] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.793964] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 883.793964] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.793964] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 883.793964] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 883.793964] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f519ad49-9922-4eef-90e3-57f7a8f7fa71 already deleted. [ 883.793964] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f519ad49-9922-4eef-90e3-57f7a8f7fa71" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.111196] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.111335] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.111408] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.111680] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.111796] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.111910] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 794731d2-b850-4b68-8e84-3ce1ca4aeecf already deleted. [ 884.112012] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.112216] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.112349] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.112436] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('794731d2-b850-4b68-8e84-3ce1ca4aeecf',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.343426] env[70879]: INFO networking_nsxv3.common.synchronization [req-414afe25-c7e4-41d4-b0bc-bb91bece0642 req-7bcefc6a-eb38-45c1-a83c-0639a0fdfc94 tempest-SecurityGroupRulesNegativeTestJSON-63090634 tempest-SecurityGroupRulesNegativeTestJSON-63090634-project-member] Enqueued Resource ID: cff0b912-fbfb-4285-864c-c0450b5ba896 with Priority: HIGHEST for action security_group_rules [ 884.343426] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff0b912-fbfb-4285-864c-c0450b5ba896 with Priority: HIGHEST for action security_group_rules [ 884.343426] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cff0b912-fbfb-4285-864c-c0450b5ba896 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.343426] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cff0b912-fbfb-4285-864c-c0450b5ba896" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.343426] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cff0b912-fbfb-4285-864c-c0450b5ba896" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.343940] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cff0b912-fbfb-4285-864c-c0450b5ba896" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.345368] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cff0b912-fbfb-4285-864c-c0450b5ba896',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.457629] env[70879]: INFO networking_nsxv3.common.synchronization [None req-2757652e-0395-4547-9e77-9feff0883593 None None] Enqueued Resource ID: a2317633-6497-44bf-992c-b6cda1352e35 with Priority: HIGHEST for action port [ 884.457890] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2317633-6497-44bf-992c-b6cda1352e35 with Priority: HIGHEST for action port [ 884.458523] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2317633-6497-44bf-992c-b6cda1352e35 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.460050] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2317633-6497-44bf-992c-b6cda1352e35" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.460050] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2317633-6497-44bf-992c-b6cda1352e35" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.461821] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2317633-6497-44bf-992c-b6cda1352e35" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.462018] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2317633-6497-44bf-992c-b6cda1352e35',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.634034] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.634188] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.634240] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.634454] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.634538] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.634631] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 794731d2-b850-4b68-8e84-3ce1ca4aeecf already deleted. [ 884.634711] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-794731d2-b850-4b68-8e84-3ce1ca4aeecf" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.867572] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.867916] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.867916] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.867982] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.868062] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.868231] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cff0b912-fbfb-4285-864c-c0450b5ba896 already deleted. [ 884.868412] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cff0b912-fbfb-4285-864c-c0450b5ba896" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.967267] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2317633-6497-44bf-992c-b6cda1352e35 [ 884.967481] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.967591] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 884.967688] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.967844] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 884.967941] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 884.968040] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2317633-6497-44bf-992c-b6cda1352e35 already deleted. [ 884.968123] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2317633-6497-44bf-992c-b6cda1352e35" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.300358] env[70879]: INFO networking_nsxv3.common.synchronization [req-2879c422-30fa-4697-90ad-6f97b98a689c req-cd31b10b-5218-4a6c-90a2-4de0b9cf2932 tempest-SecurityGroupRulesNegativeTestJSON-63090634 tempest-SecurityGroupRulesNegativeTestJSON-63090634-project-member] Enqueued Resource ID: cff0b912-fbfb-4285-864c-c0450b5ba896 with Priority: HIGHEST for action security_group_rules [ 885.300941] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff0b912-fbfb-4285-864c-c0450b5ba896 with Priority: HIGHEST for action security_group_rules [ 885.304429] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cff0b912-fbfb-4285-864c-c0450b5ba896 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.304673] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cff0b912-fbfb-4285-864c-c0450b5ba896" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.304673] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cff0b912-fbfb-4285-864c-c0450b5ba896" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.304839] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cff0b912-fbfb-4285-864c-c0450b5ba896" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.304917] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cff0b912-fbfb-4285-864c-c0450b5ba896',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.414601] env[70879]: INFO networking_nsxv3.common.synchronization [None req-974c82eb-2777-47c7-9134-3cd1912da62e None None] Enqueued Resource ID: cfddb1ca-921a-4e03-b307-5f6f05dde4a8 with Priority: HIGHEST for action port [ 885.415308] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfddb1ca-921a-4e03-b307-5f6f05dde4a8 with Priority: HIGHEST for action port [ 885.415953] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfddb1ca-921a-4e03-b307-5f6f05dde4a8 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.417592] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfddb1ca-921a-4e03-b307-5f6f05dde4a8" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.417751] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfddb1ca-921a-4e03-b307-5f6f05dde4a8" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.418086] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfddb1ca-921a-4e03-b307-5f6f05dde4a8" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.418299] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfddb1ca-921a-4e03-b307-5f6f05dde4a8',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.829148] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.829351] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.829439] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.829662] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.829754] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.829849] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cff0b912-fbfb-4285-864c-c0450b5ba896 already deleted. [ 885.829931] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cff0b912-fbfb-4285-864c-c0450b5ba896" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.921490] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfddb1ca-921a-4e03-b307-5f6f05dde4a8 [ 885.921759] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.921858] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 885.921974] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.922201] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 885.922316] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 885.922449] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfddb1ca-921a-4e03-b307-5f6f05dde4a8 already deleted. [ 885.922542] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfddb1ca-921a-4e03-b307-5f6f05dde4a8" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 888.912992] env[70879]: INFO networking_nsxv3.common.synchronization [None req-653ef474-b479-4ab3-94d6-36820efc3b0b None None] Enqueued Resource ID: 074de9e7-5505-43f0-b0ab-ca04dd82c1f6 with Priority: HIGHEST for action port [ 888.914543] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074de9e7-5505-43f0-b0ab-ca04dd82c1f6 with Priority: HIGHEST for action port [ 888.914543] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-074de9e7-5505-43f0-b0ab-ca04dd82c1f6 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.914543] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-074de9e7-5505-43f0-b0ab-ca04dd82c1f6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 888.914543] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-074de9e7-5505-43f0-b0ab-ca04dd82c1f6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.914749] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-074de9e7-5505-43f0-b0ab-ca04dd82c1f6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 888.914793] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('074de9e7-5505-43f0-b0ab-ca04dd82c1f6',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.417589] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 074de9e7-5505-43f0-b0ab-ca04dd82c1f6 [ 889.417835] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.417972] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 889.418065] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.418324] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 889.418489] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 889.418584] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:074de9e7-5505-43f0-b0ab-ca04dd82c1f6 already deleted. [ 889.418615] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-074de9e7-5505-43f0-b0ab-ca04dd82c1f6" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.141646] env[70879]: INFO networking_nsxv3.common.synchronization [None req-d064dcf8-ed99-4784-ad05-c395bc391012 None None] Enqueued Resource ID: dba6900d-3d52-4f09-9802-ce50c671d84f with Priority: HIGHEST for action port [ 891.141926] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba6900d-3d52-4f09-9802-ce50c671d84f with Priority: HIGHEST for action port [ 891.142477] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-dba6900d-3d52-4f09-9802-ce50c671d84f taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.142608] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dba6900d-3d52-4f09-9802-ce50c671d84f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.142680] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dba6900d-3d52-4f09-9802-ce50c671d84f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.142927] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dba6900d-3d52-4f09-9802-ce50c671d84f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.143038] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dba6900d-3d52-4f09-9802-ce50c671d84f',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.647629] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dba6900d-3d52-4f09-9802-ce50c671d84f [ 891.648087] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.648925] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 891.648925] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.648925] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 891.648925] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 891.648925] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dba6900d-3d52-4f09-9802-ce50c671d84f already deleted. [ 891.648925] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dba6900d-3d52-4f09-9802-ce50c671d84f" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 892.991170] env[70879]: INFO networking_nsxv3.common.synchronization [None req-0801e716-e36e-4f4f-8d50-8a4d286df3e7 None None] Enqueued Resource ID: 3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2 with Priority: HIGHEST for action port [ 892.992931] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2 with Priority: HIGHEST for action port [ 892.994307] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.994307] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 892.994307] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.994478] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 892.994563] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.488189] env[70879]: INFO networking_nsxv3.common.synchronization [None req-66cbec64-bccb-4c61-a735-0679ec7a899e None None] Enqueued Resource ID: e5b9b8bd-e764-489a-8062-bd00b3953597 with Priority: HIGHEST for action port [ 893.488189] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b9b8bd-e764-489a-8062-bd00b3953597 with Priority: HIGHEST for action port [ 893.488189] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5b9b8bd-e764-489a-8062-bd00b3953597 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.488189] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5b9b8bd-e764-489a-8062-bd00b3953597" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.488189] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5b9b8bd-e764-489a-8062-bd00b3953597" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.489616] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5b9b8bd-e764-489a-8062-bd00b3953597" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.489770] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5b9b8bd-e764-489a-8062-bd00b3953597',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.496177] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2 [ 893.496467] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.496623] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.496714] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.496936] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.497120] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.497210] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2 already deleted. [ 893.497242] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd1ef7a-cae6-4e2f-b65b-eb291a1b0ac2" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.992777] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5b9b8bd-e764-489a-8062-bd00b3953597 [ 893.993121] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.993208] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 893.993446] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.993721] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 893.993819] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 893.993909] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5b9b8bd-e764-489a-8062-bd00b3953597 already deleted. [ 893.993992] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5b9b8bd-e764-489a-8062-bd00b3953597" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.192795] env[70879]: INFO networking_nsxv3.common.synchronization [None req-e8158854-915f-4cf9-a3a2-dee7b37cf24d tempest-ServerActionsV293TestJSON-2099598270 tempest-ServerActionsV293TestJSON-2099598270-project-member] Enqueued Resource ID: 9922022d-84d1-4be7-8412-1a9056f73212 with Priority: HIGHEST for action security_group_rules [ 894.193553] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9922022d-84d1-4be7-8412-1a9056f73212 with Priority: HIGHEST for action security_group_rules [ 894.193553] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9922022d-84d1-4be7-8412-1a9056f73212 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.193553] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9922022d-84d1-4be7-8412-1a9056f73212" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.193692] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9922022d-84d1-4be7-8412-1a9056f73212" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.193939] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9922022d-84d1-4be7-8412-1a9056f73212" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.193996] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9922022d-84d1-4be7-8412-1a9056f73212',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.275635] env[70879]: INFO networking_nsxv3.common.synchronization [None req-e8f8a570-5c1c-4640-af84-cec8333adc53 tempest-ServerActionsV293TestJSON-2099598270 tempest-ServerActionsV293TestJSON-2099598270-project-member] Enqueued Resource ID: 9922022d-84d1-4be7-8412-1a9056f73212 with Priority: HIGHEST for action security_group_rules [ 894.275635] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9922022d-84d1-4be7-8412-1a9056f73212 with Priority: HIGHEST for action security_group_rules [ 894.275635] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9922022d-84d1-4be7-8412-1a9056f73212 taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.275635] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9922022d-84d1-4be7-8412-1a9056f73212" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.718817] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.719235] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 894.719235] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.719313] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.719466] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.719466] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9922022d-84d1-4be7-8412-1a9056f73212 already deleted. [ 894.719552] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9922022d-84d1-4be7-8412-1a9056f73212" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 894.719693] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9922022d-84d1-4be7-8412-1a9056f73212" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.719876] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9922022d-84d1-4be7-8412-1a9056f73212" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 894.719934] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9922022d-84d1-4be7-8412-1a9056f73212',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.133028] env[70879]: INFO networking_nsxv3.common.synchronization [None req-f0a480ad-f42e-4010-979c-6b8d1d3c0c22 None None] Enqueued Resource ID: be9b53dc-f811-4746-a42e-27082f453a4e with Priority: HIGHEST for action port [ 895.133028] env[70879]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9b53dc-f811-4746-a42e-27082f453a4e with Priority: HIGHEST for action port [ 895.133028] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock port-be9b53dc-f811-4746-a42e-27082f453a4e taken with stack trace [, , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.133028] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be9b53dc-f811-4746-a42e-27082f453a4e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.133028] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be9b53dc-f811-4746-a42e-27082f453a4e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.135045] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be9b53dc-f811-4746-a42e-27082f453a4e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.135045] env[70879]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be9b53dc-f811-4746-a42e-27082f453a4e',) {} {{(pid=70879) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.243019] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.243019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.243019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.243019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.243019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.243019] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9922022d-84d1-4be7-8412-1a9056f73212 already deleted. [ 895.243019] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9922022d-84d1-4be7-8412-1a9056f73212" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.637095] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be9b53dc-f811-4746-a42e-27082f453a4e [ 895.637744] env[70879]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70879) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.637744] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:310}} [ 895.637744] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.637744] env[70879]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:321}} [ 895.637988] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 895.637988] env[70879]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be9b53dc-f811-4746-a42e-27082f453a4e already deleted. [ 895.637988] env[70879]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be9b53dc-f811-4746-a42e-27082f453a4e" {{(pid=70879) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:331}} [ 900.132731] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 900.133170] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 905.133474] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 905.133877] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 910.134835] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 910.135288] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 915.136221] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 915.136638] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 920.137158] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 920.137584] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 925.138169] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 925.138605] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 930.139679] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 930.140076] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 934.678465] env[70879]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 934.678820] env[70879]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e7f3b506-1dc7-4c48-97d5-dca46cb08b15 None None] NSXv3 Agent Agent loop - iteration:1 started [ 935.140653] env[70879]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 935.140824] env[70879]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0